-- Logs begin at Thu 2021-11-25 07:57:32 UTC, end at Thu 2021-11-25 08:59:23 UTC. -- Nov 25 08:31:53.802671 dv-cinder-778193-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 25 08:31:53.810027 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 25 08:31:53 2021] *** Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: nodename: dv-cinder-778193-12-iscsi Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: machine: x86_64 Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: clock source: unix Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: pcre jit disabled Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: detected number of CPU cores: 4 Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: current working directory: / Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: detected binary path: /usr/bin/uwsgi-core Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: your processes number limit is 47680 Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: your memory page size is 4096 bytes Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: detected max file descriptor number: 2048 Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: lock engine: pthread robust mutexes Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: thunder lock: enabled Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 25 08:31:53.815465 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 25 08:31:53.858397 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: Python main interpreter initialized at 0x5588b0e839c0 Nov 25 08:31:53.858397 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: python threads support enabled Nov 25 08:31:53.858397 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: your server socket listen backlog is limited to 100 connections Nov 25 08:31:53.858397 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: your mercy for graceful operations on workers is 90 seconds Nov 25 08:31:53.858848 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: mapped 403077 bytes (393 KB) for 2 cores Nov 25 08:31:53.858848 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: *** Operational MODE: preforking *** Nov 25 08:31:53.859012 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: *** uWSGI is running in multiple interpreter mode *** Nov 25 08:31:53.859012 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: spawned uWSGI master process (pid: 108413) Nov 25 08:31:53.859209 dv-cinder-778193-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 25 08:31:53.859994 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: spawned uWSGI worker 1 (pid: 108414, cores: 1) Nov 25 08:31:53.860112 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: spawned uWSGI worker 2 (pid: 108415, cores: 1) Nov 25 08:31:53.860255 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 25 08:31:55.626437 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:31:55.626437 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: from cryptography.utils import int_from_bytes Nov 25 08:31:55.627026 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:31:55.627026 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: from cryptography.utils import int_from_bytes Nov 25 08:31:55.637208 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:31:55.637208 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: from cryptography.utils import int_from_bytes Nov 25 08:31:55.637748 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:31:55.637748 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: from cryptography.utils import int_from_bytes Nov 25 08:31:58.227374 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 25 08:31:58.227983 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 25 08:31:58.228151 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 25 08:31:58.228261 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 25 08:31:58.228614 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 25 08:31:58.228695 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 25 08:31:58.228781 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 25 08:31:58.228918 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 25 08:31:58.229114 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.229281 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 25 08:31:58.229439 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.229527 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 25 08:31:58.229760 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.229922 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.230081 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.230252 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.230411 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.230576 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.230722 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.230898 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.231043 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.231230 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.231367 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.231542 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.231720 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.231886 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.231976 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.232211 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.232351 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.232542 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.232680 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-12-iscsi {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.232802 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.232932 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.233112 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.233235 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.233438 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-12-iscsi {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.233572 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.233762 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.233885 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.234074 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.234198 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.234394 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.234520 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.234697 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.234827 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.235009 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.235206 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.235361 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.236382 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.236529 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.236529 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.236745 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.236888 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237018 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237139 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237258 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237383 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237516 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237645 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237766 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.237891 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238018 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238176 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238306 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238428 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238546 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238664 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238784 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.238903 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-12-iscsi {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.239035 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.239156 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.239275 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.239457 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.239644 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-12-iscsi {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.239800 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.239966 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.240218 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.240355 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.240528 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.240652 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.240837 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.240980 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.241159 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.241284 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.241482 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.241613 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.241793 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.241920 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.242119 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.242243 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.242456 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.242586 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.242759 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.242887 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.243077 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.243201 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.243381 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.243505 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.243713 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.243846 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.244025 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.244155 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.244344 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.244474 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.244650 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.244775 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.244955 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.245081 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.245208 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.245337 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.245504 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.245628 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.245792 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.245915 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.246102 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.246235 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.246452 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.246586 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.246710 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.246830 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.247007 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.247132 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.247255 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.247376 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.247541 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.247704 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.247875 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.248001 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.248184 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.248318 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.248492 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.248625 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.248799 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.248923 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.249105 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.249236 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.249409 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.249540 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.249715 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.249842 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.250021 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.250145 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.250326 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.250541 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.250664 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.250783 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.250942 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.251066 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.251247 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.251380 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.251579 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.251706 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.251977 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.252101 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.252231 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.252851 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.253057 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.253340 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.253540 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.253712 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.253853 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.253982 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.254103 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.254229 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.254361 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.254552 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.254687 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.254875 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.255009 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.255199 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.255323 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.255527 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.255691 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.255867 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.256000 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.256178 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.256309 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.256491 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.256629 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.256750 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.256869 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.257038 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.257165 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.257348 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.257480 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.257669 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.257793 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.257975 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.258104 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.258281 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.258405 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.258587 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.258712 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.258892 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.259030 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.259200 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.259324 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.259506 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.259717 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.259842 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.259966 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.260135 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.260261 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.260439 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.260563 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.260746 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.260880 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.261055 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.261180 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.261361 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.261484 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.261667 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.261799 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.261978 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.262103 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.262289 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.262413 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.262597 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.262732 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.262904 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.263073 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.263202 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.263327 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.263505 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.263660 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.263856 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.263982 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.264162 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.264296 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.264468 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.264601 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.264792 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.264918 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.265099 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.265222 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.265403 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.265535 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.265725 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.265855 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.266032 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.266155 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.266335 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.266467 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.266654 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.266778 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.266954 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.267077 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.267282 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.267423 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.267607 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.267736 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.268002 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.269226 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.269226 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.269506 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.269628 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.269757 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.269878 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.269999 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.270131 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.270262 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.270384 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.270512 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.270639 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.270798 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.270934 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.271107 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.271244 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.271416 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.271541 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.271742 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.271878 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.272062 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.272186 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.272390 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.272514 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.272703 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.272835 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.273014 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.273138 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.273322 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.273446 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.273645 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.273779 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:31:58.273989 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.274114 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.274324 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.274456 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.274671 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.274796 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.274986 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.275108 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.275322 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.275456 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.275682 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.275801 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.276007 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.276133 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.276323 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.276455 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.276641 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.276766 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.276968 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.277092 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.277285 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.277419 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.277597 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.277721 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.277909 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.278068 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.278228 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.278364 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.278547 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.278671 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.278878 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.279022 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.279197 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.279335 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.279511 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.279657 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.279857 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.279981 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.280171 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.280307 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.280490 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.280615 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.280866 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.281002 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.281137 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.281258 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.281442 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.281566 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.281783 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.281906 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.282127 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.282252 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.282443 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.282567 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.282765 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.282889 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.283077 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.283204 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.283400 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.283741 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.283875 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.283997 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.284137 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.284260 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.284452 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.284577 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.284792 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.284929 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.285107 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.285240 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.285422 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.285553 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.285768 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.285895 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.286091 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.286225 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.286410 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.286535 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.286715 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.286847 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.287024 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.287155 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.287331 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.287454 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.287667 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.287808 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.287973 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.288107 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.288298 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.288423 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.288631 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.288767 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.288939 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.289063 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.289275 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.289398 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.289580 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.289711 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.289892 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.290018 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.290209 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.290338 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.290496 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.290622 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.290807 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.290938 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.291116 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.291240 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.291422 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.291548 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.291773 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.291907 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.292084 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.292209 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.292391 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.292524 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.292714 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.292840 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.293021 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.293156 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.293324 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.293448 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.293642 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.293766 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.293953 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.294085 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.294262 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.294387 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.294573 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.294697 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.294892 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.295025 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.295206 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.295339 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.295515 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.295662 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.295879 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.295997 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.296215 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.296340 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.296519 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.296642 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.296844 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.296971 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.297171 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.297295 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.297487 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.297610 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.297790 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.297915 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.298101 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.298226 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.298405 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.298529 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.298712 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.298848 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.299015 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.299819 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.299961 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.300091 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.300211 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.300350 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.300483 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.300667 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.300948 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.301081 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.301260 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.301385 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.301568 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.301695 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.301893 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.302025 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.302204 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.302326 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.302509 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.302634 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.302815 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.303019 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.303144 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.303270 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.303448 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.303594 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.303782 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.303916 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.304125 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.304252 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.304462 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.304592 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.304780 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.304912 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.305104 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.305228 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.305416 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.305539 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.305732 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.305859 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.306043 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.306159 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.306355 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.306479 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.306667 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.306797 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.306976 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.307098 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.307295 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.307424 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.307630 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.307768 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.307952 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.308078 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.308261 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.308394 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.308586 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.308711 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.308897 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.309020 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.309220 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.309354 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.309527 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.309651 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.309843 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.309968 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.310183 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.310311 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.310514 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.310637 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.310830 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.310961 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.311150 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.311285 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.311461 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.311606 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.311799 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.311938 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.312112 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.312237 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.312427 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.312552 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.312740 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.312865 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.313054 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.313181 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.313375 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.313500 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.313685 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.313807 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.314002 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.314126 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.314308 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.314430 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.314628 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.314752 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.315496 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.315649 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.315846 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.316015 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.316138 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.316247 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.316456 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.316583 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.316786 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.316911 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.317118 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.317250 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.317428 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.317552 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.317740 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.317870 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.318060 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.318196 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.318369 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.318493 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.318678 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.318800 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.318988 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.319131 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.319291 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.319414 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.319617 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.319756 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.319931 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.320064 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.320246 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.320369 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.320557 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.320680 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.320866 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.320990 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.321170 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.321299 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.321744 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.321867 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.322053 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.322178 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.322359 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.322481 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.322662 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.322787 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.322972 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.323099 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.323293 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.323424 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.323622 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.323749 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.323947 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.324074 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.324269 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.324397 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.324573 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.324707 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.324879 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.325002 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.325197 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.325320 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.325506 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.325639 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.325807 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.325931 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.326109 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.326233 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.326412 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.326547 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.326754 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.326886 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.327065 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.327194 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.327370 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.327501 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.327710 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.327836 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.328031 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.328165 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.328367 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.328492 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.328640 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.328765 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.328952 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.329075 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.329259 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.329390 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.329580 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.329704 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.329896 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.330020 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.330202 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.330328 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.330633 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.330783 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.330906 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.331027 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.331305 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.331432 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.331644 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.331783 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.331970 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.332103 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.332280 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.332430 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.332589 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.332720 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.332898 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.333097 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.333223 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.333341 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.333501 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.333626 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.333819 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.333952 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.334401 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.334527 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.334735 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.334860 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.335050 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.335186 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.335371 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.335500 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.335716 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.335852 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.336037 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.336174 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.336370 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.336486 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.336697 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.336846 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.337011 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.337138 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.337317 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.337442 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.337629 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.337760 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.337937 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.338068 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.338240 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.338372 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.338550 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.338675 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.338855 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.338981 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.339159 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.339283 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.339463 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.339662 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.339789 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.339907 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.340088 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.340212 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.340392 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.340527 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.340745 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.340905 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.341037 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.341171 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.341354 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.341489 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.341656 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.341780 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.341967 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.342093 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.342272 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.342396 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.342594 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.342725 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.342905 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.343032 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.343211 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.343336 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.343514 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.343672 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.343844 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.343969 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.344186 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.344312 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.344493 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.344628 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.344834 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.344959 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.345161 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.345284 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.345501 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.345638 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.345808 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.345932 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.346159 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.346390 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.346575 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.346710 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.347023 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.347146 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.347331 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.347464 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.347660 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.347793 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.347979 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.348103 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.348289 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.348412 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.348590 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.348715 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.348901 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.349032 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.349212 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.349336 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.349520 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.349644 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.349829 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.349953 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.350131 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.350266 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.350437 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.350567 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.350740 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.350875 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.351055 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.351187 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.351365 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.351488 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.351691 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.351815 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.351994 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.352127 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.352303 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.352427 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.352611 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.352741 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.352912 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.353045 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.353220 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.353343 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.353540 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.353668 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.353831 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.353958 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.354134 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.354263 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.354450 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.354578 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.354740 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.354866 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.355047 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.355171 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.355354 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.355478 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.355678 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.355804 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.356001 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.356125 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.356308 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.356432 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.356611 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.356736 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.356910 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.357034 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.357217 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.357408 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.357533 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.357661 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.357811 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.357941 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.358116 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.358248 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.358437 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.358560 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.358749 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.358873 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.359052 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.359190 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.359359 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.359482 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.359687 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.359805 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.359991 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.360127 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.360294 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.360420 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.360599 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.360724 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.360964 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.361106 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.361236 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.361363 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.361492 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.361614 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.362337 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.362475 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.362640 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.362765 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.363044 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.363212 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.363346 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.363469 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.363646 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.363771 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.363896 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.364016 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.364150 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.364273 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.364490 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.364616 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.364799 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.364932 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.365158 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.365283 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.365464 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.365597 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.365780 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.365913 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.366099 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.366231 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.366409 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.366534 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.366720 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.366854 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.367032 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.367157 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.367337 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.367469 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.367674 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.367816 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.367989 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.368115 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.368302 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.368431 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.368607 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.368742 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.368911 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.369044 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.369233 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.369358 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.369546 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.369672 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.369858 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.369982 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.370180 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.370311 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.370503 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.370629 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.370826 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.370949 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.371130 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.371254 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.371437 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.371607 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.371771 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.371895 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.372079 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.372202 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.372387 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.372512 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.372692 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.372817 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.373004 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.373137 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.373314 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.373439 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.373623 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.373746 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.373933 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.374070 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.374241 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.374365 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.374546 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.374671 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.374853 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.374985 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.375161 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.375285 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.375464 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.375618 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.375811 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.375943 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.376119 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.376243 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.376422 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.376545 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.376727 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.376852 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.377031 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.377157 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.377865 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.378135 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.378304 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.378429 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.378611 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.378771 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.378925 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.379089 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.379224 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.379404 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.379530 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.379806 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.379932 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.380122 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.380261 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.380435 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.380561 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.380754 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.380884 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.381059 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.381191 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.381366 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.381490 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.381783 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.381907 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.382093 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.382217 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.382405 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.382529 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.382712 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.382840 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.383015 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.383139 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.383321 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.383447 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.383654 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.383792 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.383966 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.384091 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.384272 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.384396 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.384576 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.384726 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.384879 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.385004 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.385199 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.385323 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.385505 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.385638 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.385828 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.385953 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.386241 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.386371 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.386551 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.386690 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.386856 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.386980 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.387270 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.387394 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.387596 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.387738 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.387910 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.388036 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.388233 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.388358 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.388558 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.388677 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.388868 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.388993 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.389173 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.389295 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.389483 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.389607 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.389789 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.389913 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.390402 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.390542 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.390542 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.390767 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.390888 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391008 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391128 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391248 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391376 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391496 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391636 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391757 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.391956 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.392094 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.392270 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.392393 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.392592 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.392717 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.393021 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.393158 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.393335 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.393473 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.393760 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.393886 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394008 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394129 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394250 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394383 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394555 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394682 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394858 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.394985 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.395162 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.395476 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.395476 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.395766 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.395889 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396019 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396141 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396270 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396400 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396522 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396683 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396809 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.396991 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.397121 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.397294 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.397428 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.397596 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.397719 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.397902 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.398029 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.398211 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.398334 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.398521 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.398649 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.398836 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.398960 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.399148 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.399273 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.399470 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.399649 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.399789 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.399913 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.400108 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.400226 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.400418 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.400550 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.400724 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.400849 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.401025 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.401148 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.401329 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.401468 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.401630 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.401754 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.401969 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.402093 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.402274 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.402472 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.402604 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.402736 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.402908 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.403033 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.403226 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.403360 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.403535 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.403708 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.403890 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.404016 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.404206 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.404342 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.404519 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.404643 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.404837 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.404971 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.405141 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.405266 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.405448 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.405574 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.405747 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.405878 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.406053 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.406185 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.406358 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.406483 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.406660 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.406784 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.406962 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.407089 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.407265 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.407388 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.407579 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.407717 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.407885 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.408021 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.408184 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.408315 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.408523 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.408670 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.408887 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.408993 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.409201 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.409341 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.409507 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.409712 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.409837 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.409957 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.410110 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.410248 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.410457 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.410591 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.410765 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.410890 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.411102 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.411234 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.411424 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.411541 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.411790 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.411916 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.412116 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.412251 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.412430 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.412563 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.412744 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.412868 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.413064 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.413187 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.413380 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.413505 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.413697 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.413830 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.414011 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.414136 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.414328 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.414467 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.414646 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.414773 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.414965 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.415103 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.415277 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.415403 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.415624 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.415776 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.415940 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.416057 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.416255 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.416361 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.416573 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.416820 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.417122 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.417229 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.417453 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.417549 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.417767 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.417862 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.418080 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.418185 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.418393 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.418496 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.418703 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.418805 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.419015 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.419120 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.419326 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.419429 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.419659 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.419757 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.419971 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.420067 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.420279 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.420394 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.420608 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.420702 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.420927 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.421037 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.421251 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.421346 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.421572 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.421719 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.421887 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.422012 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.422202 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.422330 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.422516 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.422658 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.422832 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.422958 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.423178 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.423317 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.423489 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.423650 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.423823 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.423951 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.424644 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.424810 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.424983 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.425179 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.425341 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.425543 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.425696 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.425832 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.425955 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.426075 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.426195 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.426322 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.426476 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.426612 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.426789 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.426916 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.427104 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.427230 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.427421 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.427607 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.427778 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.427917 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.428115 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.428240 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.428437 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.428555 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.428754 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.428886 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.429139 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.429284 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.429415 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.429538 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.429670 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.429891 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.430186 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.430312 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.430569 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.430705 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.430827 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.430947 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.431142 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.431268 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.431462 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.431632 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.431819 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.431943 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.432109 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.432249 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.432418 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.432543 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.432740 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.432870 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.433031 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.433163 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.433340 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.433465 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.433645 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.433784 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.433947 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.434084 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.434267 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.434391 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.434574 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.434699 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.434878 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.435012 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.435189 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.435315 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.435497 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.435750 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.436052 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.436187 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.436400 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.436525 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.436718 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.436843 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.437041 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.437166 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.437360 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.437492 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.437669 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.437794 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.437978 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.438103 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.438290 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.438415 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.438596 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.438731 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.438902 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.439029 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.439217 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.439334 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.439526 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.439733 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.440385 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.440531 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.440704 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.440827 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.441013 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.441314 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.441473 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.441630 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.441757 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.441913 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.442010 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.442230 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.442317 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.442537 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.442622 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.442844 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.442942 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.443152 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.443238 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.443456 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.443540 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.443786 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.443902 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.444091 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.444178 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.444393 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.444479 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.444696 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.444803 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.445000 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.445086 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.445309 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.445398 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.445611 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.445704 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.445913 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.446006 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.446220 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.446306 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.446794 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.446894 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.447102 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.447187 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.447404 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.447489 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.447740 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.447829 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.448047 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.448132 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.448352 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.448438 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.448658 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.448744 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.448963 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.449048 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.449277 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.449368 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.449586 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.449691 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.449894 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.449979 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.450203 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.450296 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.450512 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.450606 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.450858 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.451074 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.451166 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.451457 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.451713 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.451814 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.452094 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.452179 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.452418 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.452510 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.452760 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.452846 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.453067 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.453150 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.453376 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.453469 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.453688 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.453781 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.453992 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.454077 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.454303 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.454401 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.454610 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.454694 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.454920 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.455010 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.455229 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.455316 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.456096 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.456254 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.456400 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.456550 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.456723 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.456833 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.456998 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.457115 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.457306 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.457435 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.457617 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.457779 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.457938 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.458101 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.458278 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.458420 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.458777 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.459497 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.459616 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.459697 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.459789 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.459879 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.459966 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460044 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460121 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460196 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460273 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460356 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460435 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460561 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460718 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.460891 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.461034 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.461208 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.461361 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.461515 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.461676 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.461938 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.462034 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.462524 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.462621 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.462840 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.462968 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.463163 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.463259 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.463479 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.463596 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.463822 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.463907 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.464147 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.464237 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.464460 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.464547 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.464771 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.464857 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.465084 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.465174 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.465393 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.465479 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.465723 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.465808 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.466059 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.466145 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.466386 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.466470 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.466691 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.466785 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.466998 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.467084 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.467302 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.467394 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.467635 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.467767 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.467954 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.468062 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.468284 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.468381 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.468601 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.468715 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.468918 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.469019 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.469232 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.469352 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.469555 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.469670 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.469866 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.469993 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.470188 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.470302 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.470512 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.470619 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.470829 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.470917 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.471775 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.472008 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.472180 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.472309 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.472523 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.472641 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.472839 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.472956 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.473156 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.473269 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.473469 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.473582 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.473782 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.473883 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.474095 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.474189 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.474425 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.474510 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.474754 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.474848 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.475060 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.475156 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.475386 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.475472 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.475726 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.475830 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.476049 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.476135 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.476369 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.476454 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.476682 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.476769 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.476993 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.477084 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.477309 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.477448 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.477620 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.477708 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.477932 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.478016 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.478246 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.478345 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.478554 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.478640 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.478870 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.478958 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.479184 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.479269 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.479509 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.479632 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.479859 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.479946 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.480186 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.480284 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.480509 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.480594 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.480837 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.480930 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.481154 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.481247 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.481499 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.481585 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.481812 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.481896 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.482125 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.482221 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.482432 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.482518 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.482675 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 25 08:31:58.482762 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:31:58.482964 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108414) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 25 08:31:58.506621 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:58.507351 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_db.sqlalchemy.engines [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:58.574054 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.context [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66f22bb1-858d-4a3c-8a64-6d777ae46e0c(cell1) {{(pid=108414) load_cells /opt/stack/nova/nova/context.py:464}} Nov 25 08:31:58.578246 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_concurrency.lockutils [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:31:58.578768 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.context [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66f22bb1-858d-4a3c-8a64-6d777ae46e0c(cell1) {{(pid=108415) load_cells /opt/stack/nova/nova/context.py:464}} Nov 25 08:31:58.579837 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_concurrency.lockutils [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:31:58.581191 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_concurrency.lockutils [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:31:58.583136 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_concurrency.lockutils [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108414) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:31:58.583719 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:31:58.585334 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:31:58.586226 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:31:58.588208 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:31:58.595255 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_db.sqlalchemy.engines [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:58.597560 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_db.sqlalchemy.engines [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:58.603730 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:58.608581 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:58.762005 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG oslo_db.sqlalchemy.engines [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108414) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:58.772548 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_db.sqlalchemy.engines [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:31:59.120789 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: WARNING keystonemiddleware.auth_token [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:31:59.127004 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: WARNING keystonemiddleware.auth_token [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:31:59.128044 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: WARNING keystonemiddleware.auth_token [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:31:59.134247 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: WARNING keystonemiddleware.auth_token [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:31:59.471949 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: WARNING keystonemiddleware.auth_token [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:31:59.477230 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: WARNING keystonemiddleware.auth_token [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:31:59.482324 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588b0e839c0 pid: 108414 (default app) Nov 25 08:31:59.484402 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:31:59.485584 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Nov 25 08:31:59.486004 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Nov 25 08:31:59 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:31:59.497837 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: WARNING keystonemiddleware.auth_token [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:31:59.503742 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: WARNING keystonemiddleware.auth_token [None req-7cbd00ac-954d-4e62-9a48-f31dd2242a32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:31:59.508911 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588b0e839c0 pid: 108415 (default app) Nov 25 08:33:27.210625 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:27.211726 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Nov 25 08:33:27.212122 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:27.650924 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-f8b38f88-ee51-4bcf-aa97-a3b1162229e5 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:27.681673 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-f8b38f88-ee51-4bcf-aa97-a3b1162229e5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461950 Nov 25 08:33:27.682325 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Nov 25 08:33:27 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:33:30.158666 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:30.160568 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-73b3641b-1a9d-46ce-9b80-5030edd0ca4b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Nov 25 08:33:30.161210 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:30 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:30.229193 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-90a8204f-9090-47e1-9060-3095ea1da538 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:30.248199 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:33:30.248199 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: warnings.warn(msg) Nov 25 08:33:30.281851 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-90a8204f-9090-47e1-9060-3095ea1da538 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114140 Nov 25 08:33:30.287661 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:30.512500 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2d718923-97be-438f-8824-1534b367faf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:30.515068 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:33:30.515068 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: warnings.warn(msg) Nov 25 08:33:30.572312 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2d718923-97be-438f-8824-1534b367faf2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281084 Nov 25 08:33:30.573139 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Nov 25 08:33:30 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:33:33.142701 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-90a8204f-9090-47e1-9060-3095ea1da538 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:33.144005 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-90a8204f-9090-47e1-9060-3095ea1da538 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Nov 25 08:33:33.144531 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:33.276096 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-b0689ae1-5541-43aa-9c07-129252ed44c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:33.294069 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:33:33.294069 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: warnings.warn(msg) Nov 25 08:33:33.316726 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-b0689ae1-5541-43aa-9c07-129252ed44c4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164988 Nov 25 08:33:33.317464 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:33.330085 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-40bb9413-d177-416c-84a3-44ec8816082c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:33.333144 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:33:33.333144 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: warnings.warn(msg) Nov 25 08:33:33.380124 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-40bb9413-d177-416c-84a3-44ec8816082c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053920 Nov 25 08:33:33.381018 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Nov 25 08:33:33 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:33:35.902078 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-b0689ae1-5541-43aa-9c07-129252ed44c4 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:35.903719 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-b0689ae1-5541-43aa-9c07-129252ed44c4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002204 Nov 25 08:33:35.906662 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:35 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:35.991075 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-238d00ee-5e36-45f9-b825-cd89ab5c4116 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "swap": 0, "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:36.012525 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-238d00ee-5e36-45f9-b825-cd89ab5c4116 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097114 Nov 25 08:33:36.019608 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:36.030383 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-641d6b9a-cf67-471c-973d-f3a0ab2d0222 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:36.057026 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-641d6b9a-cf67-471c-973d-f3a0ab2d0222 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030757 Nov 25 08:33:36.057664 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Nov 25 08:33:36 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:33:38.771042 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-238d00ee-5e36-45f9-b825-cd89ab5c4116 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:38.772077 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-238d00ee-5e36-45f9-b825-cd89ab5c4116 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 25 08:33:38.772477 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:38.831998 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2c203c78-258c-4795-a52e-f89b9c3ac97b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:38.849693 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2c203c78-258c-4795-a52e-f89b9c3ac97b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070850 Nov 25 08:33:38.850247 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:38.863146 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-f52a180d-7a5e-4268-a547-166e02b76cd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:38.886338 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-f52a180d-7a5e-4268-a547-166e02b76cd9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026951 Nov 25 08:33:38.886917 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Nov 25 08:33:38 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:33:41.433326 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2c203c78-258c-4795-a52e-f89b9c3ac97b admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:41.434336 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2c203c78-258c-4795-a52e-f89b9c3ac97b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 25 08:33:41.434742 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:33:41.500197 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-16703f17-086d-455a-a9d6-8796b99f4ed2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "vcpus": 4}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:41.522180 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-16703f17-086d-455a-a9d6-8796b99f4ed2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080141 Nov 25 08:33:41.523052 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:41.535972 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-4bbdb2d9-ebdf-4350-b1aa-1d28bbba5a18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:41.560127 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-4bbdb2d9-ebdf-4350-b1aa-1d28bbba5a18 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027748 Nov 25 08:33:41.560694 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Nov 25 08:33:41 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:33:44.060249 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-16703f17-086d-455a-a9d6-8796b99f4ed2 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:44.061273 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-16703f17-086d-455a-a9d6-8796b99f4ed2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001787 Nov 25 08:33:44.062265 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:44.130434 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-b40f422c-12ca-4be6-9cb7-5ff24e3c7482 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:44.154575 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-b40f422c-12ca-4be6-9cb7-5ff24e3c7482 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085026 Nov 25 08:33:44.156079 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Nov 25 08:33:44 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:33:46.672126 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-16703f17-086d-455a-a9d6-8796b99f4ed2 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:46.672860 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-16703f17-086d-455a-a9d6-8796b99f4ed2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Nov 25 08:33:46.673344 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:46.735522 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-0c4de051-b8fe-4beb-b8f8-ab3f0f40e3a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "disk": 1}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:46.758533 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-0c4de051-b8fe-4beb-b8f8-ab3f0f40e3a5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078335 Nov 25 08:33:46.759396 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:46 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:46.776256 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-d067c8db-e2ee-4806-999d-e49689d26661 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:46.805769 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-d067c8db-e2ee-4806-999d-e49689d26661 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034086 Nov 25 08:33:46.806516 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Nov 25 08:33:46 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:33:49.767485 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-0c4de051-b8fe-4beb-b8f8-ab3f0f40e3a5 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:49.768603 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-0c4de051-b8fe-4beb-b8f8-ab3f0f40e3a5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Nov 25 08:33:49.769097 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:49.830838 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-ea6b7ad2-76a1-4281-922b-c6fc1bb1bd8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:49.849797 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-ea6b7ad2-76a1-4281-922b-c6fc1bb1bd8d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073668 Nov 25 08:33:49.850368 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:49 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:49.863124 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-d37746d1-b131-4f7e-9aa0-9511efb3846c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:49.886849 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-d37746d1-b131-4f7e-9aa0-9511efb3846c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027944 Nov 25 08:33:49.887431 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Nov 25 08:33:49 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:33:52.390958 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-ea6b7ad2-76a1-4281-922b-c6fc1bb1bd8d admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:52.392002 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-ea6b7ad2-76a1-4281-922b-c6fc1bb1bd8d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002251 Nov 25 08:33:52.392418 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:52.455869 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-7f258561-eb65-45b2-ae1d-0a5753b919db admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:52.473870 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-7f258561-eb65-45b2-ae1d-0a5753b919db admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074541 Nov 25 08:33:52.474428 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:52 2021] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:33:52.491223 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-ae6e2f94-a694-44a9-aaa5-be0304367a06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:52.535889 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-ae6e2f94-a694-44a9-aaa5-be0304367a06 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048140 Nov 25 08:33:52.536879 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Nov 25 08:33:52 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:33:55.215821 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-7f258561-eb65-45b2-ae1d-0a5753b919db admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:55.217488 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-7f258561-eb65-45b2-ae1d-0a5753b919db admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Nov 25 08:33:55.218020 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:55.284437 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-4bb4b66c-3796-4711-bbcc-bf67bb5b8a6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:55.305290 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-4bb4b66c-3796-4711-bbcc-bf67bb5b8a6f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080063 Nov 25 08:33:55.305869 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:55 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:33:55.319167 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-5d4ec241-251d-4016-aa8a-dd3c1c095122 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:55.347096 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-5d4ec241-251d-4016-aa8a-dd3c1c095122 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031470 Nov 25 08:33:55.347726 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Nov 25 08:33:55 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:33:57.835501 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-4bb4b66c-3796-4711-bbcc-bf67bb5b8a6f admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:33:57.836656 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-4bb4b66c-3796-4711-bbcc-bf67bb5b8a6f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Nov 25 08:33:57.837564 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:33:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:33:57.902414 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-a17e746c-b631-44ca-a406-a2c9799e593d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:57.922821 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-a17e746c-b631-44ca-a406-a2c9799e593d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078071 Nov 25 08:33:57.923953 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Nov 25 08:33:57 2021] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:33:57.937389 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-010b5631-24bd-4c5e-8dcd-5dfbdf3c8007 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:33:57.967235 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-010b5631-24bd-4c5e-8dcd-5dfbdf3c8007 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033685 Nov 25 08:33:57.968780 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Nov 25 08:33:57 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:34:19.377307 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-a17e746c-b631-44ca-a406-a2c9799e593d admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:19.378433 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-a17e746c-b631-44ca-a406-a2c9799e593d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Nov 25 08:34:19.378922 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:34:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:19.441036 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-ac767695-7e26-4422-967e-e28dd59598f7 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:19.459268 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-ac767695-7e26-4422-967e-e28dd59598f7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073291 Nov 25 08:34:19.459832 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Nov 25 08:34:19 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:34:21.090858 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-a17e746c-b631-44ca-a406-a2c9799e593d admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:21.091886 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-a17e746c-b631-44ca-a406-a2c9799e593d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 25 08:34:21.092286 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:21.289917 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e2597180-8d34-4877-b3e6-00039b70db05 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:21.295494 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.wsgi [None req-e2597180-8d34-4877-b3e6-00039b70db05 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 25 08:34:21.296115 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e2597180-8d34-4877-b3e6-00039b70db05 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:34:21.297468 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e2597180-8d34-4877-b3e6-00039b70db05 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063815 Nov 25 08:34:21.298222 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Nov 25 08:34:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 25 08:34:21.308504 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-550ea0ea-82d4-4178-8b80-05f37f0d0228 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:21.331902 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-550ea0ea-82d4-4178-8b80-05f37f0d0228 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026883 Nov 25 08:34:21.332793 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Nov 25 08:34:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:34:21.343508 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-6b4b4b49-78e2-4027-bb32-37aef5ebd13a admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:21.367912 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-6b4b4b49-78e2-4027-bb32-37aef5ebd13a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028067 Nov 25 08:34:21.374134 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Nov 25 08:34:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:34:21.380128 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-6c97d83f-4e70-4030-b96f-bad16d6224c6 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:21.386575 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.wsgi [None req-6c97d83f-4e70-4030-b96f-bad16d6224c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 25 08:34:21.387163 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-6c97d83f-4e70-4030-b96f-bad16d6224c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:34:21.388008 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-6c97d83f-4e70-4030-b96f-bad16d6224c6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011521 Nov 25 08:34:21.388866 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Nov 25 08:34:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 25 08:34:22.904352 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-6b4b4b49-78e2-4027-bb32-37aef5ebd13a admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:22.905350 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-6b4b4b49-78e2-4027-bb32-37aef5ebd13a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Nov 25 08:34:22.905738 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:23.097852 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-77f09ede-eeea-4d28-851e-c2997385c361 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:23.103451 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.wsgi [None req-77f09ede-eeea-4d28-851e-c2997385c361 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 25 08:34:23.104040 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-77f09ede-eeea-4d28-851e-c2997385c361 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:34:23.104824 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-77f09ede-eeea-4d28-851e-c2997385c361 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058841 Nov 25 08:34:23.105331 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Nov 25 08:34:23 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 25 08:34:23.115894 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-f4b033a4-c819-47e5-9ef5-b4644384b5cf admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:23.129791 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-f4b033a4-c819-47e5-9ef5-b4644384b5cf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017469 Nov 25 08:34:23.130348 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Nov 25 08:34:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:34:23.140490 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-af04e9a3-eb57-4325-8055-9320e78b2d3c admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:23.154340 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-af04e9a3-eb57-4325-8055-9320e78b2d3c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017268 Nov 25 08:34:23.154906 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Nov 25 08:34:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:34:23.165592 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-ebb954c9-6c3f-416e-91fc-3b4fc5bb0480 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:23.170867 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.wsgi [None req-ebb954c9-6c3f-416e-91fc-3b4fc5bb0480 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 25 08:34:23.171431 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-ebb954c9-6c3f-416e-91fc-3b4fc5bb0480 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:34:23.172605 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-ebb954c9-6c3f-416e-91fc-3b4fc5bb0480 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010348 Nov 25 08:34:23.172929 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Nov 25 08:34:23 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 25 08:34:24.662463 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-af04e9a3-eb57-4325-8055-9320e78b2d3c admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:24.663490 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-af04e9a3-eb57-4325-8055-9320e78b2d3c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 25 08:34:24.663925 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:24.865492 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-07c6d48f-d31b-4f06-aeef-5606527e934c admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:24.870763 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.wsgi [None req-07c6d48f-d31b-4f06-aeef-5606527e934c admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 25 08:34:24.871324 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-07c6d48f-d31b-4f06-aeef-5606527e934c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:34:24.872158 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-07c6d48f-d31b-4f06-aeef-5606527e934c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061163 Nov 25 08:34:24.872666 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Nov 25 08:34:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 25 08:34:24.883460 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-f498f5c3-70b4-4593-80b7-a5960c288f9a admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:24.897322 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-f498f5c3-70b4-4593-80b7-a5960c288f9a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017754 Nov 25 08:34:24.897797 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Nov 25 08:34:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:34:24.909220 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:24.923883 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019245 Nov 25 08:34:24.924451 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Nov 25 08:34:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:34:24.934662 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-262c2961-9b03-495c-b5f0-33a2320471ee admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:24.940052 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.wsgi [None req-262c2961-9b03-495c-b5f0-33a2320471ee admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 25 08:34:24.940613 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-262c2961-9b03-495c-b5f0-33a2320471ee admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108414) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:34:24.941399 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-262c2961-9b03-495c-b5f0-33a2320471ee admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010365 Nov 25 08:34:24.941908 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Nov 25 08:34:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 25 08:34:26.474373 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:26.475473 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Nov 25 08:34:26.475978 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:26.671019 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-19861d2e-38a9-4f00-a706-30ead96f1476 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:34:26.690435 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-19861d2e-38a9-4f00-a706-30ead96f1476 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071712 Nov 25 08:34:26.690977 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Nov 25 08:34:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:34:28.196725 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:28.197722 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Nov 25 08:34:28.198120 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:28.396931 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-7b9167c3-2af6-458a-9377-cd4a6eeb7bc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:34:28.418420 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-7b9167c3-2af6-458a-9377-cd4a6eeb7bc3 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075404 Nov 25 08:34:28.418891 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Nov 25 08:34:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:34:29.919305 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:29.920350 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 25 08:34:29.920751 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:30.116238 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-b20e940e-308c-4e5c-a90e-cb5e5606daec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:34:30.135438 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-b20e940e-308c-4e5c-a90e-cb5e5606daec admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072812 Nov 25 08:34:30.135933 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Nov 25 08:34:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:34:31.648970 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:31.649990 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 25 08:34:31.650390 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:34:31.847905 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-9c7cbe2d-e0df-46f0-a4ba-b3ca7499a137 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:34:31.866656 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-9c7cbe2d-e0df-46f0-a4ba-b3ca7499a137 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071985 Nov 25 08:34:31.867113 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Nov 25 08:34:31 2021] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:34:33.390358 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:33.392223 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 Nov 25 08:34:33.392822 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:34:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:34:33.589472 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-ce315199-c9a6-430e-90f8-0313b0b0f26f admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:34:33.610250 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-ce315199-c9a6-430e-90f8-0313b0b0f26f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078284 Nov 25 08:34:33.610833 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Nov 25 08:34:33 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:35:24.144538 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:35:24.145555 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-e501a693-9b42-4d27-90c5-df617d473903 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 25 08:35:24.145963 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Thu Nov 25 08:35:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:35:24.206971 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-5c8f2ad9-3dd2-4475-a241-5f0b80a15c27 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:35:24.228101 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-5c8f2ad9-3dd2-4475-a241-5f0b80a15c27 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075424 Nov 25 08:35:24.228694 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Nov 25 08:35:24 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:35:24.252702 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-0a574a54-2869-4395-98a9-653bd9f91377 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:35:24.260774 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-0a574a54-2869-4395-98a9-653bd9f91377 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Nov 25 08:35:24.261331 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Nov 25 08:35:24 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:35:24.274941 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-465f4df0-9f33-4bec-8ea2-85e654c0fe97 admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:35:24.284077 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-465f4df0-9f33-4bec-8ea2-85e654c0fe97 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012990 Nov 25 08:35:24.284648 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Nov 25 08:35:24 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:35:24.297292 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-eb1169d2-0cfd-4cdc-8233-903a6bedaf63 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:35:24.306364 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-eb1169d2-0cfd-4cdc-8233-903a6bedaf63 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012891 Nov 25 08:35:24.306946 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Nov 25 08:35:24 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:35:24.320444 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:35:24.329421 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012018 Nov 25 08:35:24.330592 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Nov 25 08:35:24 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:36:50.996815 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-cdaf8b45-2171-489a-9619-309027b942d6 tempest-verify_tempest_config-1336149236 tempest-verify_tempest_config-1336149236-project] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:36:50.998803 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-cdaf8b45-2171-489a-9619-309027b942d6 tempest-verify_tempest_config-1336149236 tempest-verify_tempest_config-1336149236-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109200 Nov 25 08:36:50.999527 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1133 bytes} [Thu Nov 25 08:36:50 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:38:19.997393 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:19.998393 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 25 08:38:19.998984 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 36/70] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:38:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:38:20.257012 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-4184e9f9-d13c-475d-9499-1f036baca618 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:20.258277 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:38:20.258277 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: warnings.warn(msg) Nov 25 08:38:20.260174 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-4184e9f9-d13c-475d-9499-1f036baca618 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:20.260705 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-4184e9f9-d13c-475d-9499-1f036baca618 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:20.261435 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-4184e9f9-d13c-475d-9499-1f036baca618 admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:20.261863 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-4184e9f9-d13c-475d-9499-1f036baca618 admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:20.297608 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-4184e9f9-d13c-475d-9499-1f036baca618 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153708 Nov 25 08:38:20.298405 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 35/71] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Nov 25 08:38:20 2021] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:38:21.816733 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:21.817741 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 25 08:38:21.818120 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 37/72] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:38:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:38:22.018422 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-bcb6ab23-6687-4782-8461-e56d7f35e00c admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:22.019605 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:38:22.019605 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: warnings.warn(msg) Nov 25 08:38:22.021187 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-bcb6ab23-6687-4782-8461-e56d7f35e00c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:22.021637 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-bcb6ab23-6687-4782-8461-e56d7f35e00c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:22.022447 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-bcb6ab23-6687-4782-8461-e56d7f35e00c admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:22.022880 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-bcb6ab23-6687-4782-8461-e56d7f35e00c admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:22.045617 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-bcb6ab23-6687-4782-8461-e56d7f35e00c admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.083562 Nov 25 08:38:22.046708 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 36/73] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Nov 25 08:38:21 2021] GET /compute/v2.1/os-services => generated 794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:38:34.038410 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:34.039407 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 25 08:38:34.039861 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:38:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:38:34.236072 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-2b88413f-c859-47d8-8bc5-939a2d4596c4 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:34.237242 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:38:34.237242 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: warnings.warn(msg) Nov 25 08:38:34.238753 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-2b88413f-c859-47d8-8bc5-939a2d4596c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:34.239190 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-2b88413f-c859-47d8-8bc5-939a2d4596c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:34.240113 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-2b88413f-c859-47d8-8bc5-939a2d4596c4 admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:34.240458 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-2b88413f-c859-47d8-8bc5-939a2d4596c4 admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:34.268157 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-2b88413f-c859-47d8-8bc5-939a2d4596c4 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085132 Nov 25 08:38:34.268774 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 37/75] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Nov 25 08:38:34 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:38:35.790280 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: DEBUG nova.api.openstack.wsgi [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] Calling method '>' {{(pid=108414) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:35.791341 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: INFO nova.api.openstack.requestlog [None req-2aa855f5-3cf4-4002-9995-4e8e2da9ef0a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Nov 25 08:38:35.791771 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: [pid: 108414|app: 0|req: 39/76] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Nov 25 08:38:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:38:36.001990 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG nova.api.openstack.wsgi [None req-da629a28-6215-4f0d-8e5d-a9523f4ce7d5 admin admin] Calling method '>' {{(pid=108415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:38:36.002924 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:38:36.002924 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: warnings.warn(msg) Nov 25 08:38:36.004293 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-da629a28-6215-4f0d-8e5d-a9523f4ce7d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:36.004735 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-da629a28-6215-4f0d-8e5d-a9523f4ce7d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:36.005533 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-da629a28-6215-4f0d-8e5d-a9523f4ce7d5 admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:38:36.005962 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: DEBUG oslo_concurrency.lockutils [None req-da629a28-6215-4f0d-8e5d-a9523f4ce7d5 admin admin] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:38:36.027840 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: INFO nova.api.openstack.requestlog [None req-da629a28-6215-4f0d-8e5d-a9523f4ce7d5 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.093505 Nov 25 08:38:36.028406 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: [pid: 108415|app: 0|req: 38/77] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Nov 25 08:38:35 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:39:36.073997 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: Thu Nov 25 08:39:36 2021 - graceful shutdown triggered... Nov 25 08:39:36.074511 dv-cinder-778193-12-iscsi devstack@n-api.service[108414]: Gracefully killing worker 1 (pid: 108414)... Nov 25 08:39:36.074123 dv-cinder-778193-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 25 08:39:36.075300 dv-cinder-778193-12-iscsi devstack@n-api.service[108415]: Gracefully killing worker 2 (pid: 108415)... Nov 25 08:39:37.075155 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: worker 1 buried after 1 seconds Nov 25 08:39:37.075155 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: worker 2 buried after 1 seconds Nov 25 08:39:37.075155 dv-cinder-778193-12-iscsi devstack@n-api.service[108413]: goodbye to uWSGI. Nov 25 08:39:37.076714 dv-cinder-778193-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 25 08:39:37.077306 dv-cinder-778193-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 25 08:39:37.081015 dv-cinder-778193-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 25 08:39:37.090116 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 25 08:39:37 2021] *** Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: nodename: dv-cinder-778193-12-iscsi Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: machine: x86_64 Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: clock source: unix Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: pcre jit disabled Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: detected number of CPU cores: 4 Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: current working directory: / Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: detected binary path: /usr/bin/uwsgi-core Nov 25 08:39:37.092123 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: your processes number limit is 47680 Nov 25 08:39:37.092821 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: your memory page size is 4096 bytes Nov 25 08:39:37.092821 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: detected max file descriptor number: 2048 Nov 25 08:39:37.092821 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: lock engine: pthread robust mutexes Nov 25 08:39:37.092821 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: thunder lock: enabled Nov 25 08:39:37.092821 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 25 08:39:37.092821 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 25 08:39:37.139602 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: Python main interpreter initialized at 0x556b853ae9c0 Nov 25 08:39:37.139602 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: python threads support enabled Nov 25 08:39:37.139602 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: your server socket listen backlog is limited to 100 connections Nov 25 08:39:37.139602 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: your mercy for graceful operations on workers is 90 seconds Nov 25 08:39:37.140058 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: mapped 403077 bytes (393 KB) for 2 cores Nov 25 08:39:37.140058 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: *** Operational MODE: preforking *** Nov 25 08:39:37.140316 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: *** uWSGI is running in multiple interpreter mode *** Nov 25 08:39:37.140316 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: spawned uWSGI master process (pid: 122623) Nov 25 08:39:37.140518 dv-cinder-778193-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 25 08:39:37.141855 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: spawned uWSGI worker 1 (pid: 122641, cores: 1) Nov 25 08:39:37.142281 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: spawned uWSGI worker 2 (pid: 122643, cores: 1) Nov 25 08:39:37.145540 dv-cinder-778193-12-iscsi devstack@n-api.service[122623]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 25 08:39:39.056351 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:39:39.056351 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: from cryptography.utils import int_from_bytes Nov 25 08:39:39.057035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:39:39.057035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: from cryptography.utils import int_from_bytes Nov 25 08:39:39.057176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:39:39.057176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: from cryptography.utils import int_from_bytes Nov 25 08:39:39.057636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 25 08:39:39.057636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: from cryptography.utils import int_from_bytes Nov 25 08:39:41.514055 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 25 08:39:41.514597 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 25 08:39:41.514810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 25 08:39:41.515162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 25 08:39:41.515420 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 25 08:39:41.516465 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.516790 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.517367 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.517517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.517850 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.518165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.518491 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.518812 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.519141 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.519403 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.519746 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.520068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-12-iscsi {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.520392 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.520700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.521010 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.521330 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.521633 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.521954 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.522267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.522769 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.523225 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.523538 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.523875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.524216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.524533 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.524845 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.525164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.525473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.525798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.526107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.526514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-12-iscsi {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.526835 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.527151 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.527464 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.527908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.528021 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 25 08:39:41.528406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 25 08:39:41.528487 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.528566 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.528765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 25 08:39:41.528862 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.529050 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 25 08:39:41.529160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.529312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 25 08:39:41.529438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.529700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.529812 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.530027 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.530126 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.530345 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.530440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.530663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.530767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.530964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.531081 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.531291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.531538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532038 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532456 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532456 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532812 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.532973 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.533188 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.533289 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-12-iscsi {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.533509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.533617 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.533836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.534091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.534173 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.534250 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.534405 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.534515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.534686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.534852 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.535001 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.535145 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.535295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.535446 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.535629 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.535881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.535977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.536189 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.536289 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.536496 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.536617 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.536822 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.536937 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.537108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.537208 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.537413 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.537519 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.537720 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.537821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.538034 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.538133 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.538350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.538442 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.538669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.538771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.538978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.539068 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.539306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.539712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.539964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.540183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-12-iscsi {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.540313 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.540598 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.540681 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.540916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.541003 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.541224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.541304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.541543 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.541666 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.541892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.541994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.542163 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.542293 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.542468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.542619 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.542772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.542947 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.543097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.543263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.543435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.543617 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.543767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.543945 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.544025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.544271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.544361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.544600 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.544700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.544898 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.544978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.545205 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.545290 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.545512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.545600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.545818 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.545899 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.546118 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.546216 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.546422 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.546553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.546728 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.546836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.547127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.547259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.547510 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.547628 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.547848 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.547961 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.548157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.548257 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.548465 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.548562 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.548772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.548862 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.549079 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.549181 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.549401 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.549487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.549728 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.549865 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.550037 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.550158 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.550344 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.550460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.550652 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.550750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.550959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.551070 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.551290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.551394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.551653 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.551754 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.551914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.552039 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.552233 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.552361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.552542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.552684 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.552851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.553014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.553174 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.553326 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.553483 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.553651 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.553793 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.554054 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.554144 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.554310 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.554400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.554623 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.554719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.554974 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.555082 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.555293 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.555389 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.555618 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.555716 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.555927 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.556033 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.556234 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.556345 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.556539 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.556658 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.556856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.557037 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.557131 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.557213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.557438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.557550 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.557737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.557857 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.558057 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.558155 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.558326 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.558421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.558631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.558730 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.558940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.559029 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.559263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.559360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.559634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.559744 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.559912 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.560026 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.560225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.560329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.560529 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.560639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.560838 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.560943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.561148 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.561252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.561460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.561565 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.561771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.561875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.562082 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.562178 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.562410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.562510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.563212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.563369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.563527 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.563708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.563869 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.564020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.564173 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.564325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.564476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.564630 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.564774 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.564916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.565066 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.565219 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.565370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.565523 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.565675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.565819 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.565970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.566121 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.566271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.566421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.566572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.566715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.566947 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.567117 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.567263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.567413 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.567691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.567976 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.568141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.568294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.568446 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.568598 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.568742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.568894 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.569047 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.569199 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.569358 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.569508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.569658 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.569810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.569964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.570107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.570250 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.570392 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.570557 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.570702 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.570852 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.570997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.571139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.571296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.571453 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.571627 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.571778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.571921 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.572072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.572215 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.572371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.572530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.572687 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.572830 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.572976 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.573126 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.573308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.573466 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.573628 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.573773 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.573925 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.574077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.574221 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.574377 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.574523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 25 08:39:41.574686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.574834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.574984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.575139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.575296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.575296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.575595 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.575746 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.575889 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.576048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.576200 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.576346 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.576489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.576631 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.576772 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.576923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.577076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.577220 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.577375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.577528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.577690 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.577943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.578190 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.578959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.579127 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.579127 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.579418 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.579594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.579746 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.580166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.580314 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.580458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.580679 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.580826 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.580968 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.580968 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.581248 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.581400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.581575 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.581729 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.581874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.582037 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.582189 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.582333 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.582492 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.582644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.582788 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.582929 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.583080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.583238 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.583382 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.583548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.583760 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.583907 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.584068 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.584221 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.584379 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.584525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.584676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.584819 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.584962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.585119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.585264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.585407 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.585550 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.585692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.585834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.585995 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.586146 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.586298 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.586442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.586584 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.586735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.586887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.587030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.587173 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.587173 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.587468 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.587647 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.587819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.588065 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.588232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.588468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.588624 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.588786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.588940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.589084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.589235 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.589386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.589538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.589695 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.589848 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.590009 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.590161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.591358 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.591484 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.591635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.591715 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.591788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.591873 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.591946 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592254 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592321 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592406 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592558 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.592990 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.593066 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.593276 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.593378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.593505 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.593602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.593858 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.593946 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.594197 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.594396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.594480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.594591 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.594790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.594898 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.595106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.595215 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.595425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.595585 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.595781 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.595913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.596107 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.596232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.596924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597414 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597596 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597684 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.597774 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.598014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.598115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.598336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.598427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.598646 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.598735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.598954 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.599060 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.599264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.599361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.599669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.599813 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.599907 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.599997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.600211 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.600399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.600554 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.600703 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.600857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.601037 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.601198 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.604754 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.604958 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.605147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.605313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.605461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.605608 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.607499 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.608371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.608558 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.608742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.608898 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.609061 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.609231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.609392 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.609658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.609871 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.610051 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.610203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.610353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.610353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.610664 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.610823 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.610983 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.611143 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.611300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.611460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.611632 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.611801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.611964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.612122 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.612284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.612444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.612603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.612762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.612921 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.613071 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.613566 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.613742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.613922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.614083 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.614247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.614398 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.614577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.614782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.614947 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.615112 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.615112 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.615433 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.615626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.615870 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.616035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.616198 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.616365 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.616523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.616682 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.616833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.616989 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.617141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.617290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.617447 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.617610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.617760 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.617909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.618066 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.618216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.618216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.618559 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.618718 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.618868 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.619017 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.619191 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.619343 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.619506 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.619693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.619858 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.620015 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.620176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.620340 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.620528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.620684 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.620841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.621003 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.621153 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.621316 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.621468 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.621625 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.621784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.621941 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.622092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.622251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.622403 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.622562 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.622721 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.622887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.622887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.623189 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.623457 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.623814 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.623976 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.624126 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.624288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.624455 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.624618 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.624777 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.624955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.625634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.625634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.625965 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.626124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.626326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.626326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.626626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.626785 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.626953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.627103 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.627253 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.627425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.627606 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.627790 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.627952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.628110 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.628269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.628420 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.628589 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.628740 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.628899 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.629049 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.629207 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.629357 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.629527 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.629689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.629839 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.629996 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.630154 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.630303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.630467 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.630618 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.630769 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.630917 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.630917 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.631219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.631378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.631539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.631795 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.631951 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.632112 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.632272 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.632422 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.632579 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.632738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.632738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.632738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.633178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.633328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.633571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.633765 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.634093 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.634251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.634410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.634568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.634718 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.634869 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.635028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.635186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.635336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.635486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.635486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.635837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.635837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.636127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.636276 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.636425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.636575 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.636737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.636889 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637196 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637345 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637826 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.637983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.638274 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.638430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.638594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.638753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.638903 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.639054 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.639202 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.639360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.639517 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.639716 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.639879 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.640036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.640194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.640354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.640505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.640661 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.641458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.641633 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.641784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.641982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.642276 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.642430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.642587 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.642757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.642908 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.643075 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.643228 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.643377 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.643377 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.643701 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.643870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.644029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.644290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.644448 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.644607 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.644769 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.644934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.645092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.645243 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.645393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.645569 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.645729 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.645957 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.646118 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.646275 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.646275 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.646571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.646816 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.647001 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.647154 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.647383 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.647593 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.647754 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.647922 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.648075 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.648224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.648381 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.648532 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.648682 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.648850 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.649002 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.649163 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.649321 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.649480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.649639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.649798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.649958 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.650116 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.650116 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.650404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.650552 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.650717 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.650875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.651032 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.651198 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.651361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.651519 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.651697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.651848 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.651998 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.652233 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.652386 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.652557 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.652714 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.652872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.653029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.653204 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.653355 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.653504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.653653 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.653810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.653810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.654112 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.654280 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.654537 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.654693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.654851 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.655014 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.655166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.655326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.655483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.655691 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.655854 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.656017 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.656169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.656318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.656513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.656759 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.656913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.657071 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.657230 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.657382 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.657561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.657794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.657962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.658114 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.658271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.658421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.658570 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.658719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.658878 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.658878 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.659164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.659313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.659462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.659661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.659829 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.659988 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.660146 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.660296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.660445 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.660600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.660764 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.660915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.661072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.661230 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.661381 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.661549 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.661712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.661924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.662085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.662245 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.662394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.662556 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.662707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.662863 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.663094 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.663258 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.663408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.663603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.663775 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.663937 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.664088 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.664088 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.664373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.664550 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.664807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.664969 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.665127 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.665287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.665451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.665608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.665771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.665938 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.666096 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.666247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.666410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.666568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.666719 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.666867 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.667024 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.667182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.667342 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.667501 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.667679 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.667840 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.668009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.668168 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.668328 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.668570 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.668730 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.668888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.669045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.669208 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.669367 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.669526 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.669526 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.669820 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.669820 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.670145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.670325 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.670477 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.670627 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.670782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.670941 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.671101 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.671260 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.671411 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.671587 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.671757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.671908 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.672107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.672277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.672433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.672584 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.672741 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.672902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.672902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.673196 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.673347 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.673504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.673663 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.673892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.674045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.674207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.674357 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.674506 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.674675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.675681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.675855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.676016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.676168 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.676325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.676325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.676626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.676779 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.676937 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.677106 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.677265 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.677435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.677594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.677751 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.677903 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.678058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.678217 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.678217 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.678512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.678662 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.678810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.678967 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.679136 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.679296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.679447 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.679627 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.679791 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.680025 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.680281 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.680453 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.680623 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.680775 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.680932 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.681091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.681261 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.681413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.681570 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.681721 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.681870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.681870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.682164 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.682322 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.682474 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.682474 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.682757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.682914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.683080 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.683245 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.683403 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.683579 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.683737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.683889 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.684048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.684209 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.684361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.684511 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.684660 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.684824 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.684984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.685142 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.685306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.685468 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.685759 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.685927 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686089 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686248 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686248 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.686534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688208 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688427 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688701 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688786 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.688964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689354 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689442 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689705 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689953 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.689953 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690200 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690288 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.690921 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691264 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691716 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691784 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691850 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.691987 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692189 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692529 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692604 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692604 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692727 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692808 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.692952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.693029 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.693099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.693167 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.693560 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.693692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.693810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.693924 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.694031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.694151 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.694334 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.694460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.694671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.694807 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.695068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.695204 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.695414 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.695541 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.695760 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.696164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.696298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.696497 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.696677 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.696809 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.697129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.697261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.697457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.697639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.697794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.698109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.698238 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.698436 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.698621 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.698764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.699074 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.699203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.699409 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.699616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.699831 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.700164 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.700301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.700480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.700702 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.700834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.701204 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.701345 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.701480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.701647 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.701778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.702100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.702245 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.702487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.702615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.702807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.703055 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.703240 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.704232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.704391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.704576 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.704732 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.705370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.705513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.705650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.705778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.705904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.706090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.706438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.706599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.706735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.706925 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.707057 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.707385 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.707515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.707745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.707909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.708053 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.708362 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.708671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.708812 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.708995 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.709203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.709343 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.709656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.709787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.710057 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.710195 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.710523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.710662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.710964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.711094 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.711412 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.711650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.711896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.712036 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.712342 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.712489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.712791 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.712922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.713237 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.713369 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.713700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.713853 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.714156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.714308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.714704 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.714857 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.715133 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.715289 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.715780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.715940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.716078 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.716206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.716586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.716738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.716877 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.717100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.717239 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.717516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.717654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.717856 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.718092 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.718223 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.718478 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.718615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.718802 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.719053 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.719254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.719511 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.719719 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.719995 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.720142 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.720444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.720575 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.720882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.721012 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.721316 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.721527 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.721761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.721891 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.722207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.722345 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.722651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.722790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.723112 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.723243 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.723601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.723737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.724038 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.724171 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.724558 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.724708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.724950 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.725109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.725400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.725618 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.725916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.726058 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.726222 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.726361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.726558 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.726899 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.727191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.727332 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.727548 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.727709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.727924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.728165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.728303 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.728565 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.728700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.728892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.729133 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.729266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.729525 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.729660 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.729920 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.730058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.730364 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.730495 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.730803 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.730932 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.731280 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.731412 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.731761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.731915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.732205 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.732393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.732647 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.733049 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.733179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.733494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.733626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.733945 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.734077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.734429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.734605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.735214 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.735532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.735532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.735915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.736186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.736318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.736453 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.736453 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.736717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.736859 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.737086 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.737230 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.737367 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.737653 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.737785 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.737988 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.738169 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.738333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.738612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.738752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.738970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.739130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.739344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.739584 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.739841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.740034 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.740349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.740483 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.740831 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.740964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.741284 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.741417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.741763 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.741919 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.742174 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.742307 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.742619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.742759 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.743061 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.743199 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.743507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.743693 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.743971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.744105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.744430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.744570 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.744887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.745038 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.745255 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.745399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.745616 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.745842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.745981 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.746278 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.746419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.746555 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.746698 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.746867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.747193 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.747342 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.747516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.747753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.747885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.748188 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.748430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.748638 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.748778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.749077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.749217 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.749406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.749571 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.749738 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.750027 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.750940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.750940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.751203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.751411 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.751575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.751720 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.751863 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.752061 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.752191 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.752453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.752586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.752763 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.752975 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.753108 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.753400 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.753545 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.753712 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.753885 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.754042 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.754335 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.754477 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.754782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.754929 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.755226 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.755443 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.755641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.755867 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.756080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.756210 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.756497 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.756643 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.756770 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.756905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.757179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.757417 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.757552 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.757795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.758034 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.758185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.758423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.758600 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.758740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.759035 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.759179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.759355 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.759583 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.759722 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.759999 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.760129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.760320 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.760551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.760684 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.760954 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.761084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.761269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.761459 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.761592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.761879 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.762016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.762227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.762371 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.762508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.762793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.762931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.763103 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.763296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.763436 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.763761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.763896 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.764073 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.764256 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.764401 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.764688 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.764825 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.765006 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.765226 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.765372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.765615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.765810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.766732 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.766866 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.767000 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.767135 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.767495 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.767693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.767825 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.768072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.768203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.768403 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.768628 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.768761 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.769028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.769157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.769385 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.769603 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.769748 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.770055 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.770260 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.770505 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.770652 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.770972 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.771128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.771323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.771460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.771716 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.771920 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.772065 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.772333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.772472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.772643 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.772871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.773004 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.773280 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.773412 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.773598 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.773803 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.773935 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.774219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.774431 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.774565 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.774836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.774979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.775152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.775399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.775602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.775825 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.775963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.776106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.776454 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.776956 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.777098 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.777232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.777368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.777509 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.777771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.777914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.778048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.778185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.778313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.778541 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.778700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.778902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.779043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.779219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.779487 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.779647 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.779914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.780045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.780228 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.780506 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.780676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.780971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.781125 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.781305 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.782049 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.782240 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.782553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.782701 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.782831 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.783104 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.783244 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.783417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.783631 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.783786 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.784076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.784214 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.784411 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.784601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.784741 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.785050 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.785187 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.785391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.785623 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.785755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.785996 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.786145 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.786285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.786503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.786634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.787099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.787241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.787370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.787496 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.787644 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.787896 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.788210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.788418 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.788554 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.788837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.788967 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.789162 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.789351 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.789492 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.789794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.789931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.790108 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.790296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.790442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.790744 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.790882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.791056 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.791251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.791395 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.791697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.791848 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.792015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.792202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.792341 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.792646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.792801 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.792972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.793159 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.793291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.793598 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.793731 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.793920 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.794198 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.794330 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.794550 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.794710 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.794855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.795160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.795300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.795484 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.795721 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.795866 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.796142 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.796284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.796454 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.796640 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.796771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.797738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.797883 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.798176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.798440 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.798571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.798755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.798937 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.799077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.799385 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.799519 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.799769 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.799900 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.800126 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.800340 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.800473 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.800779 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.800915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.801099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.801378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.801511 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.801650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122641) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 25 08:39:41.801890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.802296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.802709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.803233 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.803532 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.803985 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.804395 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.804794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.805193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.805593 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 25 08:39:41.805985 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 25 08:39:41.827018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:41.831243 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_db.sqlalchemy.engines [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:41.898519 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.context [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66f22bb1-858d-4a3c-8a64-6d777ae46e0c(cell1) {{(pid=122641) load_cells /opt/stack/nova/nova/context.py:464}} Nov 25 08:39:41.900325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.context [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),66f22bb1-858d-4a3c-8a64-6d777ae46e0c(cell1) {{(pid=122643) load_cells /opt/stack/nova/nova/context.py:464}} Nov 25 08:39:41.903313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:39:41.904890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:39:41.905214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:39:41.906053 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:39:41.907395 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:39:41.908260 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:39:41.908652 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:39:41.910202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:39:41.919487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:41.921132 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_db.sqlalchemy.engines [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:41.922813 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:41.924380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_db.sqlalchemy.engines [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:42.088693 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_db.sqlalchemy.engines [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122641) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:42.095839 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_db.sqlalchemy.engines [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 25 08:39:42.418360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: WARNING keystonemiddleware.auth_token [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:39:42.421768 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: WARNING keystonemiddleware.auth_token [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:39:42.425664 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: WARNING keystonemiddleware.auth_token [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:39:42.429425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: WARNING keystonemiddleware.auth_token [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:39:42.771153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: WARNING keystonemiddleware.auth_token [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:39:42.777004 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: WARNING keystonemiddleware.auth_token [None req-b2e9040a-1baa-4c60-9e66-85d654f9145e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:39:42.782733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b853ae9c0 pid: 122643 (default app) Nov 25 08:39:42.786633 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: WARNING keystonemiddleware.auth_token [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 25 08:39:42.791924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: WARNING keystonemiddleware.auth_token [None req-723a95d0-f32d-4b89-b947-9c4c5256439a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 25 08:39:42.798330 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b853ae9c0 pid: 122641 (default app) Nov 25 08:40:17.842473 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-04e6febe-dd83-4e81-a32d-7e5258dfa749 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Action: 'create', calling method: .version_select at 0x7f970a5ddf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-437076583", "metadata": {"Type": "work"}}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:17.877613 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-640469ab-e318-4ab3-a9ae-c3fbde305168 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Action: 'create', calling method: .version_select at 0x7f970a5dff70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-778493518", "metadata": {"Type": "work"}}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:17.879408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-640469ab-e318-4ab3-a9ae-c3fbde305168 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:40:17.880488 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-640469ab-e318-4ab3-a9ae-c3fbde305168 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.238904 Nov 25 08:40:17.887180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Nov 25 08:40:16 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 25 08:40:18.059523 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701567426", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "0ddee4b4-d930-497a-91bb-d464076fa1b3"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:18.470198 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] validate_networks() for [('0ddee4b4-d930-497a-91bb-d464076fa1b3', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:40:18.827379 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-04e6febe-dd83-4e81-a32d-7e5258dfa749 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.945998 Nov 25 08:40:18.828304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 1/2] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Nov 25 08:40:16 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 1949 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 25 08:40:18.834128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-41751079-c3e2-400c-bdab-de92bdacc216 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Action: 'create', calling method: .version_select at 0x7f970a4c4af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2022587535", "metadata": {"Type": "work"}}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:18.836695 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-41751079-c3e2-400c-bdab-de92bdacc216 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:40:18.841868 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-41751079-c3e2-400c-bdab-de92bdacc216 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010895 Nov 25 08:40:18.843602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Nov 25 08:40:18 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 25 08:40:18.856620 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a18ba30f-91af-4a00-897a-252abe4afa39 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Calling method '.version_select at 0x7f970adbe820>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:18.961420 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a18ba30f-91af-4a00-897a-252abe4afa39 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba" status: 200 len: 352 microversion: 2.1 time: 0.115627 Nov 25 08:40:18.962227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:40:18 2021] GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:18.967715 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-472880dc-6223-4b59-9e0e-7f86bebd7d9a tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Action: 'create', calling method: .version_select at 0x7f970a453040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-478823374", "metadata": {"Type": "work"}}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:18.969316 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-472880dc-6223-4b59-9e0e-7f86bebd7d9a tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:40:18.970121 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-472880dc-6223-4b59-9e0e-7f86bebd7d9a tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006655 Nov 25 08:40:18.970823 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 4/5] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Nov 25 08:40:18 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 25 08:40:18.981018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9c900e78-bd97-4284-9558-2ab6ad0f7819 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Calling method '.version_select at 0x7f970a453f70>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:19.020604 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-9c900e78-bd97-4284-9558-2ab6ad0f7819 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] HTTP exception thrown: Volume tempest-invalid-1792683476 could not be found. Nov 25 08:40:19.021818 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9c900e78-bd97-4284-9558-2ab6ad0f7819 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Returning 404 to user: Volume tempest-invalid-1792683476 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:40:19.022853 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9c900e78-bd97-4284-9558-2ab6ad0f7819 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1792683476" status: 404 len: 99 microversion: 2.1 time: 0.046584 Nov 25 08:40:19.023510 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 5/6] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Nov 25 08:40:18 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1792683476 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 25 08:40:19.034176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0e59d864-ebd8-41ef-b18f-0b8cd532acee tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004463 Nov 25 08:40:19.039747 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 6/7] 10.222.0.46 () {58 vars in 1139 bytes} [Thu Nov 25 08:40:19 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 25 08:40:19.045717 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4ffe10eb-9f4c-400f-8c43-6eeaf580b747 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004119 Nov 25 08:40:19.050077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 7/8] 10.222.0.46 () {58 vars in 1136 bytes} [Thu Nov 25 08:40:19 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 25 08:40:19.056000 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-985295fe-f520-4781-b12c-68779a3be00b tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Calling method '.version_select at 0x7f970a453820>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:19.095749 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-985295fe-f520-4781-b12c-68779a3be00b tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] HTTP exception thrown: Volume c3b3852f-4a96-486c-a413-2fd651cb13b4 could not be found. Nov 25 08:40:19.096571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-985295fe-f520-4781-b12c-68779a3be00b tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Returning 404 to user: Volume c3b3852f-4a96-486c-a413-2fd651cb13b4 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:40:19.097503 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-985295fe-f520-4781-b12c-68779a3be00b tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c3b3852f-4a96-486c-a413-2fd651cb13b4" status: 404 len: 109 microversion: 2.1 time: 0.046348 Nov 25 08:40:19.098060 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 8/9] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Nov 25 08:40:19 2021] DELETE /compute/v2.1/os-volumes/c3b3852f-4a96-486c-a413-2fd651cb13b4 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:40:19.110643 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-382364ff-725b-41bd-a2f4-c3fe46bc4cf8 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Calling method '.version_select at 0x7f970a4539d0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:19.147368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-382364ff-725b-41bd-a2f4-c3fe46bc4cf8 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] HTTP exception thrown: Volume b10debc9-73c6-4984-b5e2-4d596ef5bea6 could not be found. Nov 25 08:40:19.147964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-382364ff-725b-41bd-a2f4-c3fe46bc4cf8 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] Returning 404 to user: Volume b10debc9-73c6-4984-b5e2-4d596ef5bea6 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:40:19.153514 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-382364ff-725b-41bd-a2f4-c3fe46bc4cf8 tempest-VolumesNegativeTest-636817560 tempest-VolumesNegativeTest-636817560-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b10debc9-73c6-4984-b5e2-4d596ef5bea6" status: 404 len: 109 microversion: 2.1 time: 0.045336 Nov 25 08:40:19.159681 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 9/10] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:40:19 2021] GET /compute/v2.1/os-volumes/b10debc9-73c6-4984-b5e2-4d596ef5bea6 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:40:19.500445 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:40:19.500973 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:40:19.501454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:40:19.502391 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:40:19.502391 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:40:19.529283 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:19.530211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:19.531429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:19.532203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:19.612089 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:19.622706 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for user c150bf72536c4fc3bb247e9cbb9e1b45 and project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:19.638808 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-707964007", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "50a6dc6f-b5ce-4cf1-892b-82abd7db66a1"}]}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:19.651357 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:40:19.654780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:40:19.758745 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-da66ccd0-8351-4408-8a68-765da11a3733 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.870128 Nov 25 08:40:19.760580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 2/11] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:40:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:40:19.777926 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e526c810-6582-4ae6-9acf-217231241bb9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:19.779598 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e526c810-6582-4ae6-9acf-217231241bb9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:19.840661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] validate_networks() for [('50a6dc6f-b5ce-4cf1-892b-82abd7db66a1', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:40:19.960726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e526c810-6582-4ae6-9acf-217231241bb9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:19.986853 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e526c810-6582-4ae6-9acf-217231241bb9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1217 microversion: 2.1 time: 0.216066 Nov 25 08:40:19.987760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 3/12] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:19 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:19.996468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f8d1bb43-ebc3-4341-aaf1-5ac0c2fedb46 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Calling method '.version_select at 0x7f9709328af0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:20.147245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f8d1bb43-ebc3-4341-aaf1-5ac0c2fedb46 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba" status: 200 len: 353 microversion: 2.1 time: 0.158188 Nov 25 08:40:20.148068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 4/13] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:40:19 2021] GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba => generated 353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:20.161265 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-24d2bc00-6864-4691-b041-b4957ac481e3 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Calling method '.version_select at 0x7f97093324c0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:20.240659 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-24d2bc00-6864-4691-b041-b4957ac481e3 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba" status: 200 len: 353 microversion: 2.1 time: 0.084175 Nov 25 08:40:20.241721 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 5/14] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:40:20 2021] GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:20.258337 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-62bcf758-aa41-4ac9-9f83-66e6bbf0291f tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Calling method '.version_select at 0x7f9709306dc0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:20.406325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-62bcf758-aa41-4ac9-9f83-66e6bbf0291f tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba" status: 202 len: 0 microversion: 2.1 time: 0.150300 Nov 25 08:40:20.409396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 6/15] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Nov 25 08:40:20 2021] DELETE /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:40:20.419842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bfe0a779-f2e9-4828-8185-5f1827e57a8c tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Calling method '.version_select at 0x7f9709306f70>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:20.536097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bfe0a779-f2e9-4828-8185-5f1827e57a8c tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba" status: 200 len: 352 microversion: 2.1 time: 0.124552 Nov 25 08:40:20.537588 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 7/16] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:40:20 2021] GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:21.004533 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-65b87efb-3a8a-43b5-b874-c940e93158e6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:21.005157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-65b87efb-3a8a-43b5-b874-c940e93158e6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:21.160424 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-65b87efb-3a8a-43b5-b874-c940e93158e6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:21.167533 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-65b87efb-3a8a-43b5-b874-c940e93158e6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1217 microversion: 2.1 time: 0.166712 Nov 25 08:40:21.168132 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 8/17] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:20 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:21.550913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7842b9e3-b335-4e4b-8249-5430c1ecd667 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Calling method '.version_select at 0x7f9709314b80>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:21.608931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-7842b9e3-b335-4e4b-8249-5430c1ecd667 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] HTTP exception thrown: Volume 6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba could not be found. Nov 25 08:40:21.609834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7842b9e3-b335-4e4b-8249-5430c1ecd667 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] Returning 404 to user: Volume 6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:40:21.611035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7842b9e3-b335-4e4b-8249-5430c1ecd667 tempest-VolumesGetTestJSON-1541852797 tempest-VolumesGetTestJSON-1541852797-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba" status: 404 len: 109 microversion: 2.1 time: 0.065988 Nov 25 08:40:21.612262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:40:21 2021] GET /compute/v2.1/os-volumes/6d6e9d83-b6d5-4fbb-9e82-b58d021de5ba => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:40:21.731840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:40:21.733492 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:40:21.734478 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:40:21.735198 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:40:21.742474 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:40:21.808433 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:21.809015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:21.812678 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:21.817004 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:21.917528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Getting quotas for project 7eaa0e4df2f4476cb61baa83f9e3c6b6. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:21.942508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Getting quotas for user 546e3cad06d1448487f92b68b8530e37 and project 7eaa0e4df2f4476cb61baa83f9e3c6b6. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:21.982288 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:40:21.994332 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:40:22.187068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:22.188061 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:22.213196 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:22.219315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:22.222663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:22.228489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:22.299484 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9c4c0a86-e315-46f0-9a86-a36aa3bfe832 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.767170 Nov 25 08:40:22.300162 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 10/19] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:40:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:40:22.312570 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-29932148-29ec-422a-823a-6bb3f5350eac tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:22.315860 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-29932148-29ec-422a-823a-6bb3f5350eac tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:22.785793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-29932148-29ec-422a-823a-6bb3f5350eac tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:22.821283 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-29932148-29ec-422a-823a-6bb3f5350eac tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1214 microversion: 2.1 time: 0.514474 Nov 25 08:40:22.821889 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 11/20] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:22 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1214 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:23.013086 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:23.056408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a2bb7652-7012-4d0d-b134-0f97d6010ef3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1213 microversion: 2.1 time: 0.863695 Nov 25 08:40:23.059503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 10/21] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:22 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1213 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:23.843227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e0085c86-ad5e-4c21-9f75-930ccd7abb32 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:23.844767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e0085c86-ad5e-4c21-9f75-930ccd7abb32 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:24.073922 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:24.075075 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:24.084750 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:24.086623 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:24.087662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:24.091720 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:24.164781 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e0085c86-ad5e-4c21-9f75-930ccd7abb32 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:24.175942 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e0085c86-ad5e-4c21-9f75-930ccd7abb32 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1214 microversion: 2.1 time: 0.337939 Nov 25 08:40:24.182158 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 12/22] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:23 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1214 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:24.475216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:24.485584 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2f996e78-3d2b-4d34-b3eb-53b3ce56e314 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1275 microversion: 2.1 time: 0.415173 Nov 25 08:40:24.496296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:24 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1275 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:25.194705 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:25.195335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:25.206756 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:25.208957 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:25.213443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:25.216335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:25.503709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:25.505522 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:25.521697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:25.526633 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:25.533035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:25.536738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:25.848690 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:25.860399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0ad96ac3-8754-4073-99a5-5ca9ce9df8d0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1275 microversion: 2.1 time: 0.361289 Nov 25 08:40:25.864967 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:25 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1275 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:26.051909 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:26.071285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c44a15f1-90e1-4c09-9f66-a1bba05a250c tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1266 microversion: 2.1 time: 0.881956 Nov 25 08:40:26.071895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:25 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1266 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:26.887733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:26.889095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:26.905216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:26.906696 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:26.921600 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:26.923263 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:27.091586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:27.101132 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:27.112562 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:27.113311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:27.114333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:27.116106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:27.376707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:27.389185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e686f87f-62a8-4c93-9902-cdab19d28d3f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1275 microversion: 2.1 time: 0.505402 Nov 25 08:40:27.392288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 13/26] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:26 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1275 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:27.946464 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:27.975628 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8ff7ee4f-7aad-4991-878d-14c570a3e221 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1272 microversion: 2.1 time: 0.888961 Nov 25 08:40:27.986092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 14/27] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:27 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1272 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:28.417175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:28.418801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:28.471341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:28.472091 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:28.473168 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:28.473842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:28.787522 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:28.797416 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3b4e9714-7aac-4979-b548-6cd4ffeeb9c7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1275 microversion: 2.1 time: 0.389188 Nov 25 08:40:28.808744 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 14/28] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:28 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1275 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:28.993708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:28.994489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:29.016801 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:29.020489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:29.021354 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:29.021809 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:29.472138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:29.481833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-bf076dba-3d10-45b0-97d3-4421bd55cfba tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1272 microversion: 2.1 time: 0.490219 Nov 25 08:40:29.485546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 15/29] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:28 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1272 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:29.816931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:29.818268 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:29.845435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:29.845435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:29.845435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:29.848453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:30.449638 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:30.467641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d7ea8aab-e7d7-472c-89b0-05406b7e1568 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1275 microversion: 2.1 time: 0.653860 Nov 25 08:40:30.470541 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 15/30] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:29 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1275 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:30.501423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:30.502190 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:30.516100 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:30.517420 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:30.518257 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:30.523930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:30.901566 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:30.915591 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fdebfff5-5ac1-4774-bfbf-ac980ba59949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1272 microversion: 2.1 time: 0.415343 Nov 25 08:40:30.921975 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 16/31] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:30 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1272 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:31.488404 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:31.489837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:31.500580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:31.502222 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:31.504487 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:31.507114 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:31.941052 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:31.941691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:31.970344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:31.970344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:31.976874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:31.977748 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:33.266778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:33.280876 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-161caf0f-317a-43da-a2da-d32f43e39022 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 1.345985 Nov 25 08:40:33.289213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 17/32] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:31 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:33.317958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:33.328977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c2d60728-2234-4fb5-8f9d-20da24b24ce8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1317 microversion: 2.1 time: 1.847588 Nov 25 08:40:33.338867 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 16/33] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:31 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1317 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:34.316688 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:34.319729 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:34.334527 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:34.336672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:34.339248 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:34.339957 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:34.346941 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:34.347702 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:34.366103 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:34.366556 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:34.367369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:34.367836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:37.065036 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:37.074877 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2db6f7ea-ad21-4300-89d9-5fa1bab51337 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 2.771722 Nov 25 08:40:37.078020 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 18/34] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:34 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 2776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:37.078454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:37.087451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f96a0459-6414-482f-86d8-1d3db00d8e86 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1317 microversion: 2.1 time: 2.744395 Nov 25 08:40:37.094096 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 17/35] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:34 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1317 bytes in 2752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:37.531400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-492e2075-d1a8-435f-83bc-d2bdd286c3f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'create', calling method: .version_select at 0x7f9709b8d5e0>, body: {"keypair": {"name": "tempest-keypair-753818226"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:37.578019 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-492e2075-d1a8-435f-83bc-d2bdd286c3f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:37.583399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-492e2075-d1a8-435f-83bc-d2bdd286c3f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for user a25f49cbab094baabb82829b4b71a5e7 and project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:37.723633 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1439444777", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66254c56-3f1c-4f89-9cff-4dcde9b8b303"}]}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:37.858029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] validate_networks() for [('66254c56-3f1c-4f89-9cff-4dcde9b8b303', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:40:38.192359 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-492e2075-d1a8-435f-83bc-d2bdd286c3f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:38.204486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-492e2075-d1a8-435f-83bc-d2bdd286c3f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for user a25f49cbab094baabb82829b4b71a5e7 and project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:38.248683 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-492e2075-d1a8-435f-83bc-d2bdd286c3f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.987824 Nov 25 08:40:38.257085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 18/36] 10.222.0.46 () {60 vars in 1157 bytes} [Thu Nov 25 08:40:37 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:38.265066 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:38.266002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:38.273303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:38.274182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:38.275292 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:38.276280 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:40.665412 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:40.684340 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5419771c-f05c-46dd-8251-92bfd84e5520 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 2.426154 Nov 25 08:40:40.695599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 19/37] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:38 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 2438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:40.722575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:40.724316 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:40.743977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:40.745366 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:40.746309 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:40.758448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:41.542629 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:41.554513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-94825220-11ce-424e-9106-fc2ce45db635 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1317 microversion: 2.1 time: 0.857053 Nov 25 08:40:41.560165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 20/38] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:40 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:41.876595 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-82f2346a-508b-4134-bfff-736d91ea69e4 req-233fa8a8-9045-4d8f-b8dd-18fb58d2b678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f3bf22-bb61-4897-986f-99ae94f9fb33", "tag": "8705540a-ee14-46e8-9a43-02522efbdeb0"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:41.878780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:41.878780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:40:41.898547 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-82f2346a-508b-4134-bfff-736d91ea69e4 req-233fa8a8-9045-4d8f-b8dd-18fb58d2b678 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:41.898998 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-82f2346a-508b-4134-bfff-736d91ea69e4 req-233fa8a8-9045-4d8f-b8dd-18fb58d2b678 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:41.915424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:40:41.915994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:40:41.920330 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:40:41.921416 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:40:41.922224 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:40:41.940460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-82f2346a-508b-4134-bfff-736d91ea69e4 req-233fa8a8-9045-4d8f-b8dd-18fb58d2b678 service nova] Creating event network-changed:8705540a-ee14-46e8-9a43-02522efbdeb0 for instance 05f3bf22-bb61-4897-986f-99ae94f9fb33 on hv-cinder-77819 Nov 25 08:40:41.941109 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-82f2346a-508b-4134-bfff-736d91ea69e4 req-233fa8a8-9045-4d8f-b8dd-18fb58d2b678 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 25 08:40:41.941762 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:41.942300 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30fb56c9-c99d-4798-b603-741565c039d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:41.942541 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:41.942751 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30fb56c9-c99d-4798-b603-741565c039d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:41.943611 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:41.944003 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30fb56c9-c99d-4798-b603-741565c039d2 None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:41.944612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30fb56c9-c99d-4798-b603-741565c039d2 None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:41.945179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:41.956880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.compute.rpcapi [None req-30fb56c9-c99d-4798-b603-741565c039d2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 25 08:40:41.958008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30fb56c9-c99d-4798-b603-741565c039d2 None None] Releasing lock "compute-rpcapi-router" {{(pid=122643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 25 08:40:41.996168 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Getting quotas for project b85d133bd71746088b6aa4cb9b1cb117. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:42.010986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Getting quotas for user 2f1f1fa8189f49048547c3f9205a1637 and project b85d133bd71746088b6aa4cb9b1cb117. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:42.018794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-30fb56c9-c99d-4798-b603-741565c039d2 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455040 Nov 25 08:40:42.019414 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 21/39] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:42.024997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:42.025926 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:42.042815 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:42.043542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:42.044544 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:42.045766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:42.048022 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:40:42.056686 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:40:42.175298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-81d1a06a-818c-4842-bbca-e2661e687165 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.090216 Nov 25 08:40:42.176154 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 19/40] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:40:37 2021] POST /compute/v2.1/servers => generated 383 bytes in 5097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:40:42.187546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ef5f1938-7fcf-4feb-b6b2-3db0521f144a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:42.188186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ef5f1938-7fcf-4feb-b6b2-3db0521f144a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:42.410518 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ef5f1938-7fcf-4feb-b6b2-3db0521f144a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:42.419550 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ef5f1938-7fcf-4feb-b6b2-3db0521f144a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1222 microversion: 2.1 time: 0.236267 Nov 25 08:40:42.423853 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 20/41] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:42 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1222 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:42.460611 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-641780233", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe88a060-11d1-49d6-a468-aec69a44188a"}], "security_groups": [{"name": "tempest-securitygroup--770807059"}], "key_name": "tempest-keypair-753818226", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:42.881662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:42.903221 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-03174074-1eaa-4b60-9e91-908b3fa57592 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 0.881765 Nov 25 08:40:42.905772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 22/42] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:42 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:42.911822 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:42.913202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:42.924084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:42.924927 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:42.926715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:42.928996 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:43.215299 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] validate_networks() for [('fe88a060-11d1-49d6-a468-aec69a44188a', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:40:43.928243 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:43.937202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-50548d1a-f8e1-4dfd-84a1-021b2abeff07 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1317 microversion: 2.1 time: 1.030050 Nov 25 08:40:43.944154 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 23/43] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:42 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1317 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:43.950200 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-873874719", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66254c56-3f1c-4f89-9cff-4dcde9b8b303"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:44.081146 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] validate_networks() for [('66254c56-3f1c-4f89-9cff-4dcde9b8b303', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:40:45.343449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:40:45.344536 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:40:45.345174 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:40:45.345907 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:40:45.346833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:40:45.365655 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:45.368107 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:45.369113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:45.370991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:45.428062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for project eb52ad5308c241089b4e2e8f09206f74. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:45.437088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for user a25f49cbab094baabb82829b4b71a5e7 and project eb52ad5308c241089b4e2e8f09206f74. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:45.474749 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:40:45.478220 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:40:45.609991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-85e18449-02ef-4721-b392-071761724bb5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.155808 Nov 25 08:40:45.613139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 21/44] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:40:42 2021] POST /compute/v2.1/servers => generated 401 bytes in 3159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 25 08:40:45.978482 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b2c44fcf-e721-467d-843d-cf5388e1f1dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'create', calling method: .version_select at 0x7f97091ef550>, body: {"keypair": {"name": "tempest-keypair-1286633930"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:46.036629 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-b2c44fcf-e721-467d-843d-cf5388e1f1dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:46.043317 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-b2c44fcf-e721-467d-843d-cf5388e1f1dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for user 30ca11853c4c45cb8d845bb83b86899c and project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:46.253264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-b2c44fcf-e721-467d-843d-cf5388e1f1dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:46.266505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-b2c44fcf-e721-467d-843d-cf5388e1f1dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for user 30ca11853c4c45cb8d845bb83b86899c and project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:46.333585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b2c44fcf-e721-467d-843d-cf5388e1f1dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.718038 Nov 25 08:40:46.334908 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 22/45] 10.222.0.46 () {62 vars in 1198 bytes} [Thu Nov 25 08:40:45 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 721 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 25 08:40:46.351689 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:46.353208 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:46.381401 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:40:46.381888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:40:46.382607 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:40:46.383095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:40:46.383928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:40:46.387821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.391444 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.392795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.393839 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.402039 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.403799 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.406581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.409207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.458738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Getting quotas for project b85d133bd71746088b6aa4cb9b1cb117. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:46.470322 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Getting quotas for user 2f1f1fa8189f49048547c3f9205a1637 and project b85d133bd71746088b6aa4cb9b1cb117. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:46.501475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:40:46.509870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:40:46.650216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-df36b008-6d37-41e4-8877-b16c8089ac21 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.704810 Nov 25 08:40:46.657076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:40:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 2712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:40:46.664129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-f0307443-849a-4e0a-97de-73c004cca076 req-de78296e-f649-47be-acc9-58c5f8c57c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b638eccc-32ee-4e24-9edf-bc56e35b583b", "tag": "1358b6a2-0117-48f3-aa89-1b23f046552a"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:46.667409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:46.667409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:40:46.680531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-f0307443-849a-4e0a-97de-73c004cca076 req-de78296e-f649-47be-acc9-58c5f8c57c3d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.681328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-f0307443-849a-4e0a-97de-73c004cca076 req-de78296e-f649-47be-acc9-58c5f8c57c3d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.698902 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-f0307443-849a-4e0a-97de-73c004cca076 req-de78296e-f649-47be-acc9-58c5f8c57c3d service nova] Creating event network-changed:1358b6a2-0117-48f3-aa89-1b23f046552a for instance b638eccc-32ee-4e24-9edf-bc56e35b583b on hv-cinder-77819 Nov 25 08:40:46.707345 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-f0307443-849a-4e0a-97de-73c004cca076 req-de78296e-f649-47be-acc9-58c5f8c57c3d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048586 Nov 25 08:40:46.709029 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 25/47] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:46.715886 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:46.717733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:46.726567 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.727314 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.728544 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.729682 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.783935 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:46.799026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-481be4c4-018e-4be8-957f-26a2e9a453c8 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 0.447407 Nov 25 08:40:46.810813 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 23/48] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:46 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:46.815145 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:46.815998 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:46.831270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.835226 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:46.836111 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:46.836561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:47.475109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:47.487979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3bc679a7-8e03-4821-8c8b-c710bbff4da8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1232 microversion: 2.1 time: 0.679975 Nov 25 08:40:47.488770 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 24/49] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:46 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1232 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:47.508105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9296e812-de8b-46c6-82c5-51dfbee00537 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:47.513939 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9296e812-de8b-46c6-82c5-51dfbee00537 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:47.725259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9296e812-de8b-46c6-82c5-51dfbee00537 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:47.737356 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9296e812-de8b-46c6-82c5-51dfbee00537 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1221 microversion: 2.1 time: 0.247193 Nov 25 08:40:47.738318 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 25/50] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:47 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1221 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:47.823601 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:47.824597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:47.850660 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:47.851223 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:47.855112 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:47.857847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:48.257827 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:48.274570 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8568a475-3475-46d6-96a9-cc14387d1d7d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1317 microversion: 2.1 time: 1.559474 Nov 25 08:40:48.274570 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 26/51] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:46 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1317 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:48.506340 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:48.507162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:48.518267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:48.519066 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:48.522446 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:48.524147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:48.931278 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:48.939108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-15ae6100-7025-405b-9586-283c1e745657 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1294 microversion: 2.1 time: 0.437233 Nov 25 08:40:48.952533 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 27/52] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:48 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1294 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:48.959212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:48.959855 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:48.978224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:48.978679 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:48.979472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:48.979953 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:49.203997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:49.214127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ab8bdfb0-429e-42bf-936e-007512f34a9d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1291 microversion: 2.1 time: 0.260379 Nov 25 08:40:49.227807 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 28/53] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:48 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1291 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:49.306121 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:49.318578 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7d150631-bdbb-44bc-acdb-e417b4ad774e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 1.501731 Nov 25 08:40:49.320034 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 26/54] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:47 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:49.336673 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:49.341017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:49.359759 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-354ec3a8-791b-40fe-a13b-598b683a66f2 req-979a2a78-d27c-482d-a6f2-f4599780fec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398", "tag": "7d1f8ee3-49ee-4f81-b4cc-fb76fcde1998"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:49.361414 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:49.361414 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:40:49.362475 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:49.366329 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:49.367458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:49.368093 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:49.391117 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-354ec3a8-791b-40fe-a13b-598b683a66f2 req-979a2a78-d27c-482d-a6f2-f4599780fec3 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:49.391640 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-354ec3a8-791b-40fe-a13b-598b683a66f2 req-979a2a78-d27c-482d-a6f2-f4599780fec3 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:49.444851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-354ec3a8-791b-40fe-a13b-598b683a66f2 req-979a2a78-d27c-482d-a6f2-f4599780fec3 service nova] Creating event network-changed:7d1f8ee3-49ee-4f81-b4cc-fb76fcde1998 for instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 on hv-cinder-77819 Nov 25 08:40:49.455914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-354ec3a8-791b-40fe-a13b-598b683a66f2 req-979a2a78-d27c-482d-a6f2-f4599780fec3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224840 Nov 25 08:40:49.480226 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 29/55] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:49.970005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:49.970712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:49.987276 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:49.987767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:49.988574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:49.989016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:50.164119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:50.179773 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b8184be8-f869-4d19-a087-b239f4400f2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1294 microversion: 2.1 time: 0.209236 Nov 25 08:40:50.180992 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 30/56] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:49 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1294 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:50.233733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:50.234599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:50.251022 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:50.252072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:50.252877 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:50.253839 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:50.254436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:50.264073 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b23f148e-d043-4134-bcb2-e02ed72952f9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1317 microversion: 2.1 time: 0.939245 Nov 25 08:40:50.265238 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 27/57] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:49 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1317 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:50.337894 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:50.338557 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:50.348485 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:50.349207 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:50.350233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:50.350819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:50.429796 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:50.445588 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c5400999-54de-424b-9c3a-91ef723b9c5b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1279 microversion: 2.1 time: 0.216418 Nov 25 08:40:50.446349 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 31/58] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:50 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1279 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:50.723958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-f88b25b3-de7e-492b-9067-2ddf42a68087 req-d0f29f77-f936-4222-84ad-e0d4d7a83fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f3bf22-bb61-4897-986f-99ae94f9fb33", "name": "network-vif-plugged", "status": "completed", "tag": "8705540a-ee14-46e8-9a43-02522efbdeb0"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:50.725798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:50.725798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:40:50.741217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-f88b25b3-de7e-492b-9067-2ddf42a68087 req-d0f29f77-f936-4222-84ad-e0d4d7a83fcf service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:50.741809 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-f88b25b3-de7e-492b-9067-2ddf42a68087 req-d0f29f77-f936-4222-84ad-e0d4d7a83fcf service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:50.769946 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-f88b25b3-de7e-492b-9067-2ddf42a68087 req-d0f29f77-f936-4222-84ad-e0d4d7a83fcf service nova] Creating event network-vif-plugged:8705540a-ee14-46e8-9a43-02522efbdeb0 for instance 05f3bf22-bb61-4897-986f-99ae94f9fb33 on hv-cinder-77819 Nov 25 08:40:50.777507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-f88b25b3-de7e-492b-9067-2ddf42a68087 req-d0f29f77-f936-4222-84ad-e0d4d7a83fcf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178702 Nov 25 08:40:50.779218 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 32/59] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:51.056364 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1000101498", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1f23e0-ed6b-4bcd-b801-85ff9727a35c"}], "security_groups": [{"name": "tempest-securitygroup--1152462018"}], "key_name": "tempest-keypair-1286633930", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:51.519356 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:51.526667 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-66ccc4d5-e857-46f8-9acc-58c48c9e79e6 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 1.192357 Nov 25 08:40:51.528019 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 28/60] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:50 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:51.533555 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:51.534173 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:51.540215 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:51.540663 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:51.542013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:51.542480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:51.593500 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] validate_networks() for [('cd1f23e0-ed6b-4bcd-b801-85ff9727a35c', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:40:51.769433 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:51.783761 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6c603069-f23d-4000-ad33-999f08ef811e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1294 microversion: 2.1 time: 0.254082 Nov 25 08:40:51.793458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 29/61] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:51 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1294 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:51.793458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:51.793458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:51.797594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:51.798134 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:51.799473 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:51.800139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:52.318665 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:52.336109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6778d44a-b5e5-4faa-9000-dfe58a02cb1b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1317 microversion: 2.1 time: 0.549026 Nov 25 08:40:52.337309 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 30/62] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:51 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:52.345433 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:52.347153 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:52.357938 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:52.359759 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:52.361387 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:52.362018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:53.045286 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:53.059270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0038786a-c699-4395-8ac6-374b09f0e302 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.716544 Nov 25 08:40:53.060242 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 31/63] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:52 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:53.066447 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:53.072551 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:53.086672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:53.087581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:53.088594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:53.093349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:53.406402 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:40:53.407712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:40:53.408441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:40:53.408881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:40:53.409373 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:40:53.436826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:53.448261 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:53.449699 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:53.450305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:53.495378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for project af706c5a572d4008b111a87e96ebf814. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:40:53.507977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for user 30ca11853c4c45cb8d845bb83b86899c and project af706c5a572d4008b111a87e96ebf814. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:40:53.534116 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:40:53.538546 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:40:53.676846 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-626ca02b-bb3f-4364-94f6-e98f8b89af9c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.624058 Nov 25 08:40:53.678396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 33/64] 10.222.0.46 () {62 vars in 1187 bytes} [Thu Nov 25 08:40:51 2021] POST /compute/v2.1/servers => generated 402 bytes in 2628 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 25 08:40:53.690231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-1f51ec34-77e5-400b-a5f3-4100faebb49c req-ad357439-a20c-4f2e-9d45-d8964c21da4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b638eccc-32ee-4e24-9edf-bc56e35b583b", "name": "network-vif-plugged", "status": "completed", "tag": "1358b6a2-0117-48f3-aa89-1b23f046552a"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:53.692066 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:53.692066 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:40:53.702509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-1f51ec34-77e5-400b-a5f3-4100faebb49c req-ad357439-a20c-4f2e-9d45-d8964c21da4b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:53.702958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-1f51ec34-77e5-400b-a5f3-4100faebb49c req-ad357439-a20c-4f2e-9d45-d8964c21da4b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:53.715014 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-1f51ec34-77e5-400b-a5f3-4100faebb49c req-ad357439-a20c-4f2e-9d45-d8964c21da4b service nova] Creating event network-vif-plugged:1358b6a2-0117-48f3-aa89-1b23f046552a for instance b638eccc-32ee-4e24-9edf-bc56e35b583b on hv-cinder-77819 Nov 25 08:40:53.722712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-1f51ec34-77e5-400b-a5f3-4100faebb49c req-ad357439-a20c-4f2e-9d45-d8964c21da4b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041766 Nov 25 08:40:53.723409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 34/65] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:53.729682 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:53.741061 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:53.763946 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:53.764715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:53.765868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:53.766508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:54.379254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:54.391991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6965b534-d390-4c24-a808-3fd9a5aed3ff tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 1.327986 Nov 25 08:40:54.393796 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 32/66] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:53 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:54.406270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:54.413026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:54.428161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:54.431261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:54.433611 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:54.437843 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:54.570550 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:54.584692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e88acb2f-d1a6-4cf7-bcd1-cb86c706a0ea tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.859849 Nov 25 08:40:54.587660 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 35/67] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:53 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:54.600672 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:54.601760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:54.620012 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:54.620705 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:54.623704 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:54.624906 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:54.750234 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:54.759138 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:54.760663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:54.761769 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a6a93dbe-f62a-49f1-8ea8-71d3db5b2157 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1278 microversion: 2.20 time: 0.168770 Nov 25 08:40:54.765560 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 36/68] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:40:54 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:40:54.770517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:54.771412 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:54.778305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:54.779300 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:54.780361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:54.781101 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:55.098488 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:55.109262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f1f1bc28-ea4a-48f6-936c-272151ccfdc7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1507 microversion: 2.1 time: 0.709716 Nov 25 08:40:55.109979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 33/69] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:54 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1507 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:55.263165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:55.270791 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-61cd1bc3-5ab4-4763-9bcf-23b96ba85de7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.503859 Nov 25 08:40:55.274211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 37/70] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:54 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:55.414148 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:55.415066 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:55.430527 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-c2e3224d-bc7e-4fdf-90af-49a6f5e24043 req-88978f40-485b-4060-b2b2-164d463e150d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1aedc08-397b-4391-8040-58633cd7f2b0", "tag": "9924f829-de6d-4b9e-b3ef-17a50b2a8e5f"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:55.432125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:55.432125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:40:55.432507 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:55.433913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:55.437324 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:55.439623 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:55.448536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-c2e3224d-bc7e-4fdf-90af-49a6f5e24043 req-88978f40-485b-4060-b2b2-164d463e150d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:55.451485 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-c2e3224d-bc7e-4fdf-90af-49a6f5e24043 req-88978f40-485b-4060-b2b2-164d463e150d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:55.473322 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-c2e3224d-bc7e-4fdf-90af-49a6f5e24043 req-88978f40-485b-4060-b2b2-164d463e150d service nova] Creating event network-changed:9924f829-de6d-4b9e-b3ef-17a50b2a8e5f for instance d1aedc08-397b-4391-8040-58633cd7f2b0 on hv-cinder-77819 Nov 25 08:40:55.478651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-c2e3224d-bc7e-4fdf-90af-49a6f5e24043 req-88978f40-485b-4060-b2b2-164d463e150d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051859 Nov 25 08:40:55.479638 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 38/71] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:55.605872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:55.611631 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:55.636831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:55.637287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:55.646823 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:55.647414 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.326403 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:56.335818 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9ef0d5bc-357b-4ac1-b2ac-b83e2e6e9d29 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.734849 Nov 25 08:40:56.336397 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 39/72] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:55 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:56.348073 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:56.348937 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:56.357131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:56.362623 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.363081 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.363942 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.364372 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.365631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6f1d5742-e53e-4319-a951-dc34e6dc30aa tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1314 microversion: 2.1 time: 0.958625 Nov 25 08:40:56.369114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 34/73] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:55 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1314 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:56.374841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-c3d12164-10ae-4ef8-8758-eb7349ce79ec req-12254b0c-870d-4388-bff2-1b4dcc82e89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398", "name": "network-vif-plugged", "status": "completed", "tag": "7d1f8ee3-49ee-4f81-b4cc-fb76fcde1998"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:56.377075 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:56.377075 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:40:56.389715 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-c3d12164-10ae-4ef8-8758-eb7349ce79ec req-12254b0c-870d-4388-bff2-1b4dcc82e89b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.390149 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-c3d12164-10ae-4ef8-8758-eb7349ce79ec req-12254b0c-870d-4388-bff2-1b4dcc82e89b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.412024 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-c3d12164-10ae-4ef8-8758-eb7349ce79ec req-12254b0c-870d-4388-bff2-1b4dcc82e89b service nova] Creating event network-vif-plugged:7d1f8ee3-49ee-4f81-b4cc-fb76fcde1998 for instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 on hv-cinder-77819 Nov 25 08:40:56.412845 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-c3d12164-10ae-4ef8-8758-eb7349ce79ec req-12254b0c-870d-4388-bff2-1b4dcc82e89b service nova] Acquired lock "compute-rpcapi-router" {{(pid=122641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 25 08:40:56.415013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d594c19b-b2b7-4f83-b252-1493f7e7de09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.416089 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d594c19b-b2b7-4f83-b252-1493f7e7de09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.417052 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d594c19b-b2b7-4f83-b252-1493f7e7de09 None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.417909 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d594c19b-b2b7-4f83-b252-1493f7e7de09 None None] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.427220 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.compute.rpcapi [None req-d594c19b-b2b7-4f83-b252-1493f7e7de09 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 25 08:40:56.428319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d594c19b-b2b7-4f83-b252-1493f7e7de09 None None] Releasing lock "compute-rpcapi-router" {{(pid=122641) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 25 08:40:56.457012 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d594c19b-b2b7-4f83-b252-1493f7e7de09 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086247 Nov 25 08:40:56.458177 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 35/74] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:56.464734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:56.465641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:56.476531 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.476878 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.477683 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.478120 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.751406 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:56.761753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:56.763489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:56.764535 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f7f6a937-745b-484c-b39d-0b314a3937ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1340 microversion: 2.20 time: 0.420034 Nov 25 08:40:56.765077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 40/75] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:40:56 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1340 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:40:56.970639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a38020c1-d6a1-4686-98e5-4d4d2b4300e7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c9947b1-a993-4fa9-9a26-6a13399636b6"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:56.972770 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a38020c1-d6a1-4686-98e5-4d4d2b4300e7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:56.987936 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a38020c1-d6a1-4686-98e5-4d4d2b4300e7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.989156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a38020c1-d6a1-4686-98e5-4d4d2b4300e7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:56.989156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a38020c1-d6a1-4686-98e5-4d4d2b4300e7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:56.989519 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a38020c1-d6a1-4686-98e5-4d4d2b4300e7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:57.297577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:57.305592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4c560cf8-cd8f-4a22-8b33-f5871bad7b16 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.846081 Nov 25 08:40:57.308720 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 36/76] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:56 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:57.356447 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:57.357825 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:57.367094 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:57.368271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:57.369090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:57.369529 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:57.561770 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a38020c1-d6a1-4686-98e5-4d4d2b4300e7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.595417 Nov 25 08:40:57.563164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 41/77] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:40:56 2021] POST /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments => generated 194 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:57.579743 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:57.582365 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:57.595351 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:57.596240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:57.597326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:57.598120 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:57.918433 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:57.928377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5ecb23b5-ff95-45ad-91d6-3494c6c6680f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.578483 Nov 25 08:40:57.929659 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 37/78] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:57 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:40:57.940412 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-ea8e7856-4802-4e30-aa7e-0c9105b55f58 req-fd194ce8-8f0d-4d24-b339-d684624f6186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ffb424-199d-477b-a9f0-afc0246d1fba", "tag": "427dce62-22d3-4c59-9af7-e194abc69928"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:57.948136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:40:57.948136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:40:57.976422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-ea8e7856-4802-4e30-aa7e-0c9105b55f58 req-fd194ce8-8f0d-4d24-b339-d684624f6186 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:57.978023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-ea8e7856-4802-4e30-aa7e-0c9105b55f58 req-fd194ce8-8f0d-4d24-b339-d684624f6186 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:58.018247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-ea8e7856-4802-4e30-aa7e-0c9105b55f58 req-fd194ce8-8f0d-4d24-b339-d684624f6186 service nova] Creating event network-changed:427dce62-22d3-4c59-9af7-e194abc69928 for instance 69ffb424-199d-477b-a9f0-afc0246d1fba on hv-cinder-77819 Nov 25 08:40:58.033972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-ea8e7856-4802-4e30-aa7e-0c9105b55f58 req-fd194ce8-8f0d-4d24-b339-d684624f6186 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099309 Nov 25 08:40:58.035646 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 38/79] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:40:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:40:58.043700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:58.046877 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:58.055329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:58.058451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:58.059176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:58.060480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:58.061535 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:58.063789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-768d04f6-9f70-4f04-9589-2ba1dbb02289 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1500 microversion: 2.1 time: 0.499076 Nov 25 08:40:58.079891 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 42/80] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:57 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1500 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:58.327321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:58.327961 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:58.344371 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:58.345487 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:58.347767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:58.348369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:58.894972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:58.925236 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:58.933302 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:58.935597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-255abce4-8f8d-4fe2-b69a-9448b89bf3e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.898587 Nov 25 08:40:58.938320 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 39/81] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:40:58 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:40:58.950966 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:58.951353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:58.958645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:58.959281 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:58.960302 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:58.960740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:59.362273 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:59.368896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7bced749-4ebf-4190-89e8-69245342f0c8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 1.046605 Nov 25 08:40:59.369637 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 43/82] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:58 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:59.675272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6cd48cbd-ccf3-4309-ba05-b49b5b8ce519 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cca9056b-8f59-4727-a8cc-dda178ca72bd"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:40:59.677514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6cd48cbd-ccf3-4309-ba05-b49b5b8ce519 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:59.692211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6cd48cbd-ccf3-4309-ba05-b49b5b8ce519 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:59.692802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6cd48cbd-ccf3-4309-ba05-b49b5b8ce519 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:59.696504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6cd48cbd-ccf3-4309-ba05-b49b5b8ce519 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:59.698772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6cd48cbd-ccf3-4309-ba05-b49b5b8ce519 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:59.850638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:40:59.866691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4ca5816d-1ee8-412d-be31-73b6a47ca99d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.919354 Nov 25 08:40:59.877433 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 40/83] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:40:58 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:40:59.956076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:40:59.956760 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:40:59.969560 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:59.970065 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:40:59.972177 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:40:59.975312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:00.271813 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6cd48cbd-ccf3-4309-ba05-b49b5b8ce519 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "POST /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598443 Nov 25 08:41:00.276739 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 44/84] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:40:59 2021] POST /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:41:00.386902 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:00.387678 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:00.394563 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:00.400607 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:00.401142 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:00.401848 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:00.402278 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:00.405166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:00.413200 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:00.416308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-15f9c5d3-56d3-48cf-9ec6-1b43edfed318 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.464069 Nov 25 08:41:00.429674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 41/85] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:40:59 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:41:00.694470 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-e5bd9999-b811-4f81-9eb5-f62b02ae6406 req-c7915a73-475a-46e7-bd7c-30e06a31859a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861e5c47-a03f-44f8-8181-954812e9b38b", "tag": "e813642c-c46b-4870-94db-1582911a9fad"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:00.703406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:00.703406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:41:00.718986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-e5bd9999-b811-4f81-9eb5-f62b02ae6406 req-c7915a73-475a-46e7-bd7c-30e06a31859a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:00.720677 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-e5bd9999-b811-4f81-9eb5-f62b02ae6406 req-c7915a73-475a-46e7-bd7c-30e06a31859a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:00.725430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:00.738015 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-427c7f8d-6d3f-490a-a6a6-5bdbb23b67ed tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.352962 Nov 25 08:41:00.740997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 45/86] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:00 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:00.752240 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-e5bd9999-b811-4f81-9eb5-f62b02ae6406 req-c7915a73-475a-46e7-bd7c-30e06a31859a service nova] Creating event network-changed:e813642c-c46b-4870-94db-1582911a9fad for instance 861e5c47-a03f-44f8-8181-954812e9b38b on hv-cinder-77819 Nov 25 08:41:00.759068 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-e5bd9999-b811-4f81-9eb5-f62b02ae6406 req-c7915a73-475a-46e7-bd7c-30e06a31859a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070730 Nov 25 08:41:00.760321 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 42/87] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:00.884853 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:00.885473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:00.897293 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:00.897757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:00.911454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:00.912211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:01.292416 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:01.305007 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e2e5e414-c9e8-4143-b3bf-dce6dc951b45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.423086 Nov 25 08:41:01.305602 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 46/88] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:00 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:01.436838 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:01.438278 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:01.451758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:01.453037 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:01.453965 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:01.454699 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:01.719163 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:01.726960 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:01.728489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:01.729827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4b085437-02be-4e67-9b51-d4de0a55797e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.297097 Nov 25 08:41:01.730396 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 43/89] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:01 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:01.756280 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:01.757567 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:01.764803 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:01.765701 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:01.766712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:01.767336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:01.978203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:01.985967 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bd11dc93-7889-40ca-bfe7-f9ac32d17d49 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.233460 Nov 25 08:41:01.986545 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 47/90] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:01 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:02.322241 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:02.322882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:02.332806 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:02.333349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:02.334648 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:02.335498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:02.506450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:02.515502 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4e6ca33e-f953-43ed-803b-a1291a2800d4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.196929 Nov 25 08:41:02.518569 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 44/91] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:02 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:02.748772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:02.749890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:02.757072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:02.757649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:02.758415 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:02.759140 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:02.918595 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:02.929186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:02.931100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:02.933152 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-418a66ce-57fa-4fbc-99ea-7320a991eb2b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.188629 Nov 25 08:41:02.946311 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 48/92] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:02 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:03.003205 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:03.003832 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:03.011336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:03.011815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:03.014011 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:03.014759 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:03.407296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:03.415292 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c7072684-c333-4ea2-8a9e-c31515195536 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.415533 Nov 25 08:41:03.425530 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 45/93] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:02 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:03.537514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:03.538510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:03.546551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:03.547218 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:03.548251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:03.548903 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:03.709162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:03.717994 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-748d9f9e-a010-4ac7-8eed-1a5811d6e3ed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.186888 Nov 25 08:41:03.719153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 49/94] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:03 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:03.952703 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:03.953649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:03.959726 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:03.960173 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:03.960943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:03.961375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:04.120709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:04.132911 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:04.136009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:04.138445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9becfdc8-d718-428b-892a-8558b756fcd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.189900 Nov 25 08:41:04.140028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 46/95] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:03 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:41:04.374936 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-b57e373d-def0-4d8f-88b6-0c7b476ac3f3 req-f52e1f4b-8b2b-4e0b-a5cb-61615f394300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ffb424-199d-477b-a9f0-afc0246d1fba", "name": "network-vif-plugged", "status": "completed", "tag": "427dce62-22d3-4c59-9af7-e194abc69928"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:04.376785 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:04.376785 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:41:04.384171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-b57e373d-def0-4d8f-88b6-0c7b476ac3f3 req-f52e1f4b-8b2b-4e0b-a5cb-61615f394300 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:04.384617 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-b57e373d-def0-4d8f-88b6-0c7b476ac3f3 req-f52e1f4b-8b2b-4e0b-a5cb-61615f394300 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:04.396171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-b57e373d-def0-4d8f-88b6-0c7b476ac3f3 req-f52e1f4b-8b2b-4e0b-a5cb-61615f394300 service nova] Creating event network-vif-plugged:427dce62-22d3-4c59-9af7-e194abc69928 for instance 69ffb424-199d-477b-a9f0-afc0246d1fba on hv-cinder-77819 Nov 25 08:41:04.400980 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-b57e373d-def0-4d8f-88b6-0c7b476ac3f3 req-f52e1f4b-8b2b-4e0b-a5cb-61615f394300 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030356 Nov 25 08:41:04.401602 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 50/96] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:04.432867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:04.433628 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:04.440363 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:04.441085 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:04.442084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:04.442795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:04.634406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:04.643516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d60a6a0f-d0c4-4ce8-ac4e-ea6692e21f7c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.214109 Nov 25 08:41:04.644134 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 47/97] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:04 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:04.737640 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:04.738444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:04.745026 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:04.745491 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:04.746425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:04.747016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:04.926613 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:04.936119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7c163120-dae2-4606-8b60-7cab65cfce51 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.202412 Nov 25 08:41:04.937025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 51/98] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:04 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:05.156494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:05.157123 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:05.163003 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:05.163399 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:05.164219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:05.164654 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:05.310169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:05.319304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:05.320945 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:05.322073 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7b0e0a8d-cc94-4a2a-ad15-be6b2cb140b0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.169343 Nov 25 08:41:05.322861 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 48/99] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:05 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:05.660274 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:05.660798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:05.666899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:05.667340 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:05.668145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:05.669244 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:05.801509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:05.809419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-029d3ad4-e44e-44b0-97ad-4ca47be3aed5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.152842 Nov 25 08:41:05.809990 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 52/100] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:05 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:05.952308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:05.952944 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:05.959017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:05.959468 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:05.960294 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:05.960733 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:06.099750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:06.107524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e681f157-6a18-4513-bcab-f6a13e9815d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.159407 Nov 25 08:41:06.108115 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 49/101] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:05 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:06.342069 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:06.342677 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:06.349368 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:06.349818 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:06.350599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:06.351057 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:06.424923 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-0b27414b-16d3-44ed-aa4d-d9c8554eeb74 req-76c0e8b2-3658-4694-91b1-9f9ad43b209b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1aedc08-397b-4391-8040-58633cd7f2b0", "name": "network-vif-plugged", "status": "completed", "tag": "9924f829-de6d-4b9e-b3ef-17a50b2a8e5f"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:06.427106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:06.427106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:41:06.433889 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-0b27414b-16d3-44ed-aa4d-d9c8554eeb74 req-76c0e8b2-3658-4694-91b1-9f9ad43b209b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:06.434361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-0b27414b-16d3-44ed-aa4d-d9c8554eeb74 req-76c0e8b2-3658-4694-91b1-9f9ad43b209b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:06.446465 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-0b27414b-16d3-44ed-aa4d-d9c8554eeb74 req-76c0e8b2-3658-4694-91b1-9f9ad43b209b service nova] Creating event network-vif-plugged:9924f829-de6d-4b9e-b3ef-17a50b2a8e5f for instance d1aedc08-397b-4391-8040-58633cd7f2b0 on hv-cinder-77819 Nov 25 08:41:06.457941 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-0b27414b-16d3-44ed-aa4d-d9c8554eeb74 req-76c0e8b2-3658-4694-91b1-9f9ad43b209b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031872 Nov 25 08:41:06.457941 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 50/102] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:41:06.492001 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:06.500350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:06.501834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:06.502934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9c6b1855-e254-479b-b0ce-6e21af2a09f8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.165246 Nov 25 08:41:06.503495 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 53/103] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:06 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:06.666496 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-729436210", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "0ddee4b4-d930-497a-91bb-d464076fa1b3"}]}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:06.723340 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] validate_networks() for [('0ddee4b4-d930-497a-91bb-d464076fa1b3', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:41:06.865270 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:06.865880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:06.873082 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:06.873536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:06.874327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:06.874766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:07.126408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:07.135095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c52281d1-5d25-4e78-be2f-adf51550ccd7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.272884 Nov 25 08:41:07.145166 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 54/104] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:06 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:07.145166 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:07.145166 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:07.150240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:07.151178 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:07.152040 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:07.152478 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:07.172068 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:41:07.172491 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:41:07.172956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:41:07.173355 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:41:07.173761 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:41:07.183224 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:07.183697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:07.184502 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:07.185102 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:07.202665 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:41:07.207590 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for user c150bf72536c4fc3bb247e9cbb9e1b45 and project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:41:07.221834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:41:07.225479 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:41:07.280920 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6d8ff14d-9406-4f69-b8d9-1d91ca2d42b6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619661 Nov 25 08:41:07.281956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 51/105] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:41:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:41:07.292962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ed90f7c0-55fc-4eaf-8571-76d1e65c4720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:07.294785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ed90f7c0-55fc-4eaf-8571-76d1e65c4720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:07.328601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:07.336554 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-14010608-1474-4285-9e05-a02170de8324 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.199297 Nov 25 08:41:07.337129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 55/106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:07 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:07.355589 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ed90f7c0-55fc-4eaf-8571-76d1e65c4720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:07.361887 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ed90f7c0-55fc-4eaf-8571-76d1e65c4720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1217 microversion: 2.1 time: 0.073246 Nov 25 08:41:07.362597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 52/107] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:07 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:07.521820 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:07.522436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:07.528860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:07.529305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:07.530096 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:07.530533 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:07.679624 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:07.687939 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:07.689461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:07.690569 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2d79391e-37a2-47a1-8cb9-a25b8efe3799 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.172444 Nov 25 08:41:07.691126 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 56/108] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:07 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:08.152237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:08.152841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:08.159428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.159901 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.160667 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.161100 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.290108 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:08.297811 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5c87ad96-41ff-419a-95f9-3957518d0957 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1321 microversion: 2.1 time: 0.149140 Nov 25 08:41:08.298382 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 53/109] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:08 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:08.353793 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:08.354542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:08.361286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.361728 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.362489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.362915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.378816 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:08.379426 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:08.385296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.385740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.386515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.386948 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.460499 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:08.469029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-11604439-c1c3-4c9b-9c50-448ceb1f9f69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1221 microversion: 2.1 time: 0.092270 Nov 25 08:41:08.469787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 54/110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:08 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:08.480408 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-d2ae4f08-da1f-4d58-99d2-429b0e42d6db req-d63aaba0-f1de-4282-a0c5-669300b10f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e5c47-a03f-44f8-8181-954812e9b38b", "name": "network-vif-plugged", "status": "completed", "tag": "e813642c-c46b-4870-94db-1582911a9fad"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:08.483319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:08.483319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:41:08.490542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d2ae4f08-da1f-4d58-99d2-429b0e42d6db req-d63aaba0-f1de-4282-a0c5-669300b10f82 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.491379 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d2ae4f08-da1f-4d58-99d2-429b0e42d6db req-d63aaba0-f1de-4282-a0c5-669300b10f82 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.503147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-d2ae4f08-da1f-4d58-99d2-429b0e42d6db req-d63aaba0-f1de-4282-a0c5-669300b10f82 service nova] Creating event network-vif-plugged:e813642c-c46b-4870-94db-1582911a9fad for instance 861e5c47-a03f-44f8-8181-954812e9b38b on hv-cinder-77819 Nov 25 08:41:08.508076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-d2ae4f08-da1f-4d58-99d2-429b0e42d6db req-d63aaba0-f1de-4282-a0c5-669300b10f82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Nov 25 08:41:08.508749 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 55/111] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:08.531178 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:08.538419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b03bcf73-c579-4428-a861-75ddfce99854 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.188313 Nov 25 08:41:08.538977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 57/112] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:08 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:08.710215 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:08.710906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:08.717567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.718014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.718781 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:08.719213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:08.848486 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:08.856319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:08.857809 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:08.858907 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-893ddf0f-92a5-422e-b4b8-3f3e8d388e3e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.152725 Nov 25 08:41:08.859459 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 56/113] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:08 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:09.314965 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:09.315592 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:09.321347 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.321800 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.322573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.323008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.456942 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:09.464191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8171c6a5-b282-4f95-8f2a-84d10130a85f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1515 microversion: 2.1 time: 0.152812 Nov 25 08:41:09.464747 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 58/114] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:09 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:09.482853 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:09.483989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:09.486179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:09.486796 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:09.490826 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.491465 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.492429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.492756 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.493011 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.493201 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.493975 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.494408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.577457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lazy-loading 'flavor' on Instance uuid 69ffb424-199d-477b-a9f0-afc0246d1fba {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:41:09.579538 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:09.586908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-73e42ece-f767-4be9-b909-fcaea82ed1c4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1269 microversion: 2.1 time: 0.104378 Nov 25 08:41:09.587494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 59/115] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:09 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:09.592955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:09.593761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:09.600359 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.601043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.601990 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.602574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.717054 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-38d9380e-8ad2-4d0f-bb44-da69b6c2293a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba/action" status: 200 len: 32 microversion: 2.1 time: 0.238972 Nov 25 08:41:09.717645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 57/116] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:09 2021] POST /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:09.734150 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:09.734849 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:09.741967 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.742483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.743363 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.744425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.760153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:09.769694 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6e33112f-99bf-4bc0-b1d8-cdcd92b17763 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.181012 Nov 25 08:41:09.770349 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 60/117] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:09 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:09.883137 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:09.883771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:09.897386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.897842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.898643 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:09.899105 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:09.909740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:09.917251 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-47dd422f-3e0d-4e4c-a87f-87b511aaa210 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.187892 Nov 25 08:41:09.931371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 58/118] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:09 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:10.127988 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:10.141872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:10.143637 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:10.145006 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-41f19d58-24cb-4fc6-acc9-48dde2701daf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.271131 Nov 25 08:41:10.145862 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 61/119] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:09 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:10.608394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:10.609007 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:10.617503 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:10.618034 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:10.618891 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:10.619469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:10.685743 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:10.696131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f7313251-adaf-4caa-9ad7-c963dbdd6821 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1275 microversion: 2.1 time: 0.091588 Nov 25 08:41:10.696720 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 59/120] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:10 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:10.787664 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:10.788115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:10.795529 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:10.796072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:10.796856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:10.797455 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:10.933820 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:10.934562 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:10.940644 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:10.941090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:10.941869 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:10.942297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:10.944508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:10.952279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-36ad2c75-ede1-43f4-a93b-9a6636d92a35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.168684 Nov 25 08:41:10.953543 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 62/121] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:10 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:11.088933 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:11.097287 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-463eacab-7224-4467-a8bb-0f713f8d16f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.166802 Nov 25 08:41:11.097856 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 60/122] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:10 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:11.164130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:11.164856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:11.171769 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:11.172324 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:11.173191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:11.173698 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:11.397565 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:11.412981 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:11.416120 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:11.418134 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8d5b4678-864e-47ae-8990-a1bbbb9deb0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.257437 Nov 25 08:41:11.419955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 63/123] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:11 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:11.715795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:11.717113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:11.723776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:11.724393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:11.725403 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:11.725916 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:11.799858 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:11.807474 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f133c008-c02c-47c0-8c0e-55e99dd5a6bd tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1275 microversion: 2.1 time: 0.096696 Nov 25 08:41:11.808078 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 61/124] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:11 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:11.971879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:11.973405 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:11.979845 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:11.980294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:11.981174 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:11.981700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:12.113950 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:12.114555 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:12.115909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:12.120955 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:12.122993 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:12.123867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:12.124364 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:12.124510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0f38eceb-793f-4a45-ba06-cde612509480 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.157354 Nov 25 08:41:12.125345 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 64/125] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:11 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:12.283599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:12.291915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-957a9222-060b-4f8b-b705-d8b5109e42ea tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.181429 Nov 25 08:41:12.292482 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 62/126] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:12 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:12.438149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:12.438771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:12.444992 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:12.445455 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:12.446249 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:12.446846 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:12.593801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:12.604473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:12.606914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:12.608443 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2532f37c-832f-43ce-a10b-1307dd59b371 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.174639 Nov 25 08:41:12.609799 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 65/127] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:12 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:12.824170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:12.824972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:12.831451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:12.831951 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:12.832743 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:12.833178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:12.913125 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:12.921854 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-bdbab96b-f31a-46be-9397-35fe98ba8079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1275 microversion: 2.1 time: 0.101370 Nov 25 08:41:12.922840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 63/128] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:12 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:13.141081 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:13.141805 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:13.149039 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.149498 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.150326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.150764 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.309429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:13.310334 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:13.318348 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.319366 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.320995 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.321735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.346630 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:13.358409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3e1d461c-8335-4e2f-8755-72a1e8df6b60 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.221084 Nov 25 08:41:13.368251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 66/129] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:13 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:13.491590 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:13.499992 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9dd5d72c-21b8-44f7-b967-dfd1a6d6ee30 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.194419 Nov 25 08:41:13.500574 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 64/130] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:13 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:13.628758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:13.629484 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:13.643045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.643045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.643045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.643045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.926691 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:13.940763 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:13.942068 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:13.953487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.955709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.957599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:13.958225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:13.959497 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:13.967020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:13.979964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1a980778-4634-42a2-87d2-e9b14a290cc4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1408 microversion: 2.20 time: 0.355668 Nov 25 08:41:13.983516 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 67/131] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:13 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1408 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:14.052115 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:14.060065 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a13c0626-c5a1-411a-b825-e77f14f693f1 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1275 microversion: 2.1 time: 0.123455 Nov 25 08:41:14.060751 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 65/132] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:13 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:14.378113 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:14.378737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:14.394024 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:14.394552 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:14.401883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:14.402363 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:14.519649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:14.520861 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:14.529990 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:14.531986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:14.535114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:14.536870 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:14.895426 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:14.905078 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c3993468-0aea-415f-8ff0-9149c4e7c55d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1361 microversion: 2.1 time: 0.531881 Nov 25 08:41:14.906274 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 68/133] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:14 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1361 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:14.926864 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:14.937659 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d56daae0-429f-4f42-b958-8d88801ada6c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.422214 Nov 25 08:41:14.938242 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 66/134] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:14 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:15.000769 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:15.001289 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:15.007156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.007630 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.008626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.009058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.078266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:15.078842 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:15.092350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.092801 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.093600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.094034 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.466363 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:15.475702 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:15.477968 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:15.481288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d73aed8b-9933-4b7c-bec5-a6c962c3279d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1601 microversion: 2.20 time: 0.483847 Nov 25 08:41:15.496245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 69/135] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:41:14 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1601 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:15.501909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7c17112a-757a-4771-b8ad-9e750dfc7114 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:15.502741 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7c17112a-757a-4771-b8ad-9e750dfc7114 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:15.510294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c17112a-757a-4771-b8ad-9e750dfc7114 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.511111 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c17112a-757a-4771-b8ad-9e750dfc7114 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.512314 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c17112a-757a-4771-b8ad-9e750dfc7114 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.512964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7c17112a-757a-4771-b8ad-9e750dfc7114 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.613138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:15.622709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a0956df8-cce1-4a2f-a1a4-090c3f157a4d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.548742 Nov 25 08:41:15.623379 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 67/136] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:15 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:15.665813 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7c17112a-757a-4771-b8ad-9e750dfc7114 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.167872 Nov 25 08:41:15.666434 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 70/137] 10.222.0.46 () {60 vars in 1315 bytes} [Thu Nov 25 08:41:15 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:15.926758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:15.927466 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:15.938051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.945183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.947062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.948050 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.957656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:15.958542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:15.969040 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.973283 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:15.976663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:15.977497 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:16.623401 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:16.630735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d1561bd8-944c-436a-8e15-8538ff884a3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1546 microversion: 2.1 time: 0.710757 Nov 25 08:41:16.631339 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 68/138] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:15 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1546 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:16.641335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-2312ea8e-7c56-46a6-9308-f051ec2a017f req-a52fcda9-c747-4889-ad95-9fc5f731e3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bea85b-e08a-4c45-9bc6-b587de1413a5", "tag": "3d904caf-5740-4806-9e49-0bff89308ad2"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:16.643740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:16.643740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:41:16.651185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-2312ea8e-7c56-46a6-9308-f051ec2a017f req-a52fcda9-c747-4889-ad95-9fc5f731e3a0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:16.651982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-2312ea8e-7c56-46a6-9308-f051ec2a017f req-a52fcda9-c747-4889-ad95-9fc5f731e3a0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:16.665831 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-2312ea8e-7c56-46a6-9308-f051ec2a017f req-a52fcda9-c747-4889-ad95-9fc5f731e3a0 service nova] Creating event network-changed:3d904caf-5740-4806-9e49-0bff89308ad2 for instance 80bea85b-e08a-4c45-9bc6-b587de1413a5 on hv-cinder-77819 Nov 25 08:41:16.671512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:16.674402 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-2312ea8e-7c56-46a6-9308-f051ec2a017f req-a52fcda9-c747-4889-ad95-9fc5f731e3a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041327 Nov 25 08:41:16.675371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 69/139] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:16.681922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:16.682879 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:16.689094 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-22cab9c3-4b93-4f21-9554-b16c41920952 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.735605 Nov 25 08:41:16.698568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 71/140] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:15 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:16.698568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bbcfc9a6-71bb-4e74-adf5-907cfb8ad6e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:16.698568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bbcfc9a6-71bb-4e74-adf5-907cfb8ad6e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:16.699117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:16.699117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:16.699117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:16.699117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:16.708538 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9a6-71bb-4e74-adf5-907cfb8ad6e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:16.708986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9a6-71bb-4e74-adf5-907cfb8ad6e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:16.709806 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9a6-71bb-4e74-adf5-907cfb8ad6e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:16.710238 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9a6-71bb-4e74-adf5-907cfb8ad6e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:16.935857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bbcfc9a6-71bb-4e74-adf5-907cfb8ad6e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244225 Nov 25 08:41:16.936064 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 72/141] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Nov 25 08:41:16 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:17.143310 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:17.149051 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:17.160453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:17.161206 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:17.162482 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:17.163433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:17.191583 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Going to try to terminate instance {{(pid=122643) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:41:17.317031 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-82a45770-7cec-41fc-8d92-1e0cb56168c9 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 204 len: 0 microversion: 2.1 time: 0.179411 Nov 25 08:41:17.321632 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 73/142] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:41:17 2021] DELETE /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:41:17.332653 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:17.333989 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:17.347483 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:17.348014 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:17.349471 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:17.350525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:17.709183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:17.718099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a07ea2eb-58e7-4400-8e86-c3b7797f43c5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 1.041213 Nov 25 08:41:17.718950 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 70/143] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:16 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:17.732197 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:17.733172 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:17.739624 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:17.740323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:17.743091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:17.743735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:17.959536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:17.972488 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f92093a7-fa18-46ec-b843-ec281a29b6de tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1552 microversion: 2.1 time: 0.645736 Nov 25 08:41:17.973384 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 74/144] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:17 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1552 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:18.220602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:18.232470 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ca0a3a36-7430-43ab-b267-785f08aa7a52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.512226 Nov 25 08:41:18.233474 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 71/145] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:17 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:18.735891 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:18.736905 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:18.745390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:18.758417 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:18.759511 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:18.760084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:18.998370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:19.000084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:19.022143 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.022775 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.023847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.025965 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.364715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:19.388320 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-40202d06-8030-493a-94ab-3afba883f980 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.654461 Nov 25 08:41:19.398124 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 75/146] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:18 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:19.441408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:19.444525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:19.478048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.481939 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.485242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.485950 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.495907 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:19.507801 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fbea09b1-cd19-483c-b01e-60fcffc62a3b tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1552 microversion: 2.1 time: 0.519895 Nov 25 08:41:19.509156 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 72/147] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:18 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1552 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:19.522628 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0407878b-6ee6-4a1d-9c3f-d5b7a6f979fa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:19.524206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0407878b-6ee6-4a1d-9c3f-d5b7a6f979fa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:19.536445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0407878b-6ee6-4a1d-9c3f-d5b7a6f979fa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.537165 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0407878b-6ee6-4a1d-9c3f-d5b7a6f979fa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.541467 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0407878b-6ee6-4a1d-9c3f-d5b7a6f979fa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.542594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0407878b-6ee6-4a1d-9c3f-d5b7a6f979fa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.819133 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:19.831394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2799c12a-f231-425c-acb7-7e6295945e2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.430897 Nov 25 08:41:19.832421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 76/148] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:19 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:19.837062 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-60b7e3e3-9c0f-4d99-a1c2-743576747904 req-c23cac5f-61fd-432a-90fa-f7ca5cabf8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861e5c47-a03f-44f8-8181-954812e9b38b", "tag": "e813642c-c46b-4870-94db-1582911a9fad"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:19.847698 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:19.847698 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:41:19.862624 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-60b7e3e3-9c0f-4d99-a1c2-743576747904 req-c23cac5f-61fd-432a-90fa-f7ca5cabf8e0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.863322 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-60b7e3e3-9c0f-4d99-a1c2-743576747904 req-c23cac5f-61fd-432a-90fa-f7ca5cabf8e0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.895925 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-60b7e3e3-9c0f-4d99-a1c2-743576747904 req-c23cac5f-61fd-432a-90fa-f7ca5cabf8e0 service nova] Creating event network-changed:e813642c-c46b-4870-94db-1582911a9fad for instance 861e5c47-a03f-44f8-8181-954812e9b38b on hv-cinder-77819 Nov 25 08:41:19.907762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-60b7e3e3-9c0f-4d99-a1c2-743576747904 req-c23cac5f-61fd-432a-90fa-f7ca5cabf8e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073840 Nov 25 08:41:19.908480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 77/149] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:19.919752 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-25096ff6-381f-4406-8e55-aa56bd65fd69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:19.925380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-25096ff6-381f-4406-8e55-aa56bd65fd69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:19.935875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25096ff6-381f-4406-8e55-aa56bd65fd69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.936319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25096ff6-381f-4406-8e55-aa56bd65fd69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:19.937296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25096ff6-381f-4406-8e55-aa56bd65fd69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:19.937887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25096ff6-381f-4406-8e55-aa56bd65fd69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:20.120371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0407878b-6ee6-4a1d-9c3f-d5b7a6f979fa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 0.608747 Nov 25 08:41:20.129613 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 73/150] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:19 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:20.144448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-25096ff6-381f-4406-8e55-aa56bd65fd69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 0.234470 Nov 25 08:41:20.145078 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 78/151] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:19 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:20.416330 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:20.417766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:20.437827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:20.438442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:20.439391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:20.440726 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:20.527118 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:20.529080 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:20.553417 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:20.557266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:20.564887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:20.566532 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:21.157539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:21.170487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b596327f-cf0a-48f0-99fb-702b8f205b42 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.759441 Nov 25 08:41:21.173600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 74/152] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:20 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:21.185554 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:21.186491 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:21.199944 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:21.202702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:21.203604 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:21.204457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:21.290019 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:21.332295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2cda35f1-401c-4f4c-b584-1b0b0d25463e tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1552 microversion: 2.1 time: 0.796754 Nov 25 08:41:21.333229 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 79/153] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:20 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1552 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:21.347444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f3c442bb-0578-4a97-bd50-dd85e13affca tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:21.355072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f3c442bb-0578-4a97-bd50-dd85e13affca tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:21.365168 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3c442bb-0578-4a97-bd50-dd85e13affca tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:21.366282 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3c442bb-0578-4a97-bd50-dd85e13affca tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:21.379743 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3c442bb-0578-4a97-bd50-dd85e13affca tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:21.380522 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3c442bb-0578-4a97-bd50-dd85e13affca tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:21.623470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f3c442bb-0578-4a97-bd50-dd85e13affca tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 0.286883 Nov 25 08:41:21.624789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 80/154] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:21 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:21.630690 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7b77cbf6-b232-49b2-866b-5c06c19dcbda tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:21.634212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7b77cbf6-b232-49b2-866b-5c06c19dcbda tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:21.662035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b77cbf6-b232-49b2-866b-5c06c19dcbda tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:21.662494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b77cbf6-b232-49b2-866b-5c06c19dcbda tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:21.663272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b77cbf6-b232-49b2-866b-5c06c19dcbda tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:21.663730 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b77cbf6-b232-49b2-866b-5c06c19dcbda tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:21.806259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7b77cbf6-b232-49b2-866b-5c06c19dcbda tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 0.179675 Nov 25 08:41:21.807199 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 81/155] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:21 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:21.972764 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-2be0444e-311d-4943-96e7-9ce31b31e266 req-8e0eec8f-de5f-42aa-88c8-a8329b9494b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1aedc08-397b-4391-8040-58633cd7f2b0", "tag": "9924f829-de6d-4b9e-b3ef-17a50b2a8e5f"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:21.975816 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:21.975816 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:41:22.008566 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:22.011601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-2be0444e-311d-4943-96e7-9ce31b31e266 req-8e0eec8f-de5f-42aa-88c8-a8329b9494b1 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.016399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-2be0444e-311d-4943-96e7-9ce31b31e266 req-8e0eec8f-de5f-42aa-88c8-a8329b9494b1 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:22.026510 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f5742ef4-113f-4ada-9f5d-977a43bec312 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.850738 Nov 25 08:41:22.027994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 75/156] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:21 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:22.068354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-2be0444e-311d-4943-96e7-9ce31b31e266 req-8e0eec8f-de5f-42aa-88c8-a8329b9494b1 service nova] Creating event network-changed:9924f829-de6d-4b9e-b3ef-17a50b2a8e5f for instance d1aedc08-397b-4391-8040-58633cd7f2b0 on hv-cinder-77819 Nov 25 08:41:22.094631 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-2be0444e-311d-4943-96e7-9ce31b31e266 req-8e0eec8f-de5f-42aa-88c8-a8329b9494b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127910 Nov 25 08:41:22.102386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 82/157] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:22.197802 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:22.211077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:22.225030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.225476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:22.226263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.226693 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:22.352902 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:22.353959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:22.360997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.361826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:22.362763 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.364018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:22.938575 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:22.949476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ed6d5423-3121-4eee-892e-673d6d039054 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.755198 Nov 25 08:41:22.958809 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:22.960151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 76/158] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:22 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:22.970100 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-52f85c11-bb41-4f1f-9af9-c8ce407a7576 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:22.971574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-60628ba0-6778-4dc0-8ee2-4122bbc87ff4 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1552 microversion: 2.1 time: 0.623881 Nov 25 08:41:22.972172 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-52f85c11-bb41-4f1f-9af9-c8ce407a7576 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:22.973874 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 83/159] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:22 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1552 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:22.988238 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a54756fe-463d-45c0-82eb-36992d896d5e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:22.989229 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a54756fe-463d-45c0-82eb-36992d896d5e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:22.993506 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52f85c11-bb41-4f1f-9af9-c8ce407a7576 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.994292 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52f85c11-bb41-4f1f-9af9-c8ce407a7576 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:22.995370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52f85c11-bb41-4f1f-9af9-c8ce407a7576 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.997647 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52f85c11-bb41-4f1f-9af9-c8ce407a7576 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:22.997971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a54756fe-463d-45c0-82eb-36992d896d5e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:22.998644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a54756fe-463d-45c0-82eb-36992d896d5e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:23.002165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a54756fe-463d-45c0-82eb-36992d896d5e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:23.002863 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a54756fe-463d-45c0-82eb-36992d896d5e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:23.129778 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a54756fe-463d-45c0-82eb-36992d896d5e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 0.154983 Nov 25 08:41:23.130571 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 84/160] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:22 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:23.137119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:23.138083 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:23.150253 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:23.152616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:23.153959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:23.154670 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:23.174065 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-52f85c11-bb41-4f1f-9af9-c8ce407a7576 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 0.211957 Nov 25 08:41:23.174855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 77/161] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:22 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:23.502723 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:23.512860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6fdd7ee1-be78-4e5c-bf5a-8b87961b280e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.380844 Nov 25 08:41:23.513749 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 85/162] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:23 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:23.967026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:23.967585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:23.975224 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:23.975877 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:23.976682 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:23.977124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:23.991210 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:23.992245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:24.011222 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:24.012032 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:24.012972 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:24.013425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:24.249528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:24.257575 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-05be3ff7-d49e-4634-b849-2ad523b64d5f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.294640 Nov 25 08:41:24.258159 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 78/163] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:23 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:24.269238 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2753c2a6-e8ee-419c-948c-17164cc010b2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:24.270349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2753c2a6-e8ee-419c-948c-17164cc010b2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:24.271104 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:24.277678 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2753c2a6-e8ee-419c-948c-17164cc010b2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:24.278340 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2753c2a6-e8ee-419c-948c-17164cc010b2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:24.281118 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2753c2a6-e8ee-419c-948c-17164cc010b2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:24.281810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2753c2a6-e8ee-419c-948c-17164cc010b2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:24.285020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d91b2295-c1bb-45f9-b878-f85255a5de12 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1552 microversion: 2.1 time: 0.296239 Nov 25 08:41:24.285792 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 86/164] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:23 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1552 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:24.308318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-64d29ee4-a866-4f74-a6f0-f7dcb8c0e725 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:24.312377 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-64d29ee4-a866-4f74-a6f0-f7dcb8c0e725 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:24.322918 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64d29ee4-a866-4f74-a6f0-f7dcb8c0e725 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:24.323644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64d29ee4-a866-4f74-a6f0-f7dcb8c0e725 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:24.324636 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64d29ee4-a866-4f74-a6f0-f7dcb8c0e725 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:24.325370 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64d29ee4-a866-4f74-a6f0-f7dcb8c0e725 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:26.898989 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-64d29ee4-a866-4f74-a6f0-f7dcb8c0e725 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 2.600847 Nov 25 08:41:26.903254 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 87/165] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:24 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 2606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:26.908867 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:26.909838 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:26.914874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2753c2a6-e8ee-419c-948c-17164cc010b2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 2.655131 Nov 25 08:41:26.916528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 79/166] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:24 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:26.925090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:26.933397 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:26.941201 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:26.941648 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:26.942462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:26.942895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:26.945360 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:26.946039 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:26.947058 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:26.952233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:27.415846 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:27.439762 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-20c6e6e4-7983-4155-a5e9-7668804a1464 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.521689 Nov 25 08:41:27.444971 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 80/167] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:26 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:27.455680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:27.455680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:27.467120 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:27.472009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:27.474988 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:27.479460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:27.480905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:27.506091 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-db4a5244-25b5-4d31-ab75-f148227ce7f9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.599247 Nov 25 08:41:27.507828 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 88/168] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:26 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:27.890069 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:27.903297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ec2f95bd-d531-4e7e-b602-01c2ea8fb971 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1552 microversion: 2.1 time: 0.456818 Nov 25 08:41:27.905988 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 81/169] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:27 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1552 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:27.915278 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-771f5c4d-1f4d-4ba3-b343-83c12cc70eac tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:27.917053 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-771f5c4d-1f4d-4ba3-b343-83c12cc70eac tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:27.926840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-62c60b99-ab0a-456b-9725-c4c328b69efb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:27.928917 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-62c60b99-ab0a-456b-9725-c4c328b69efb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:27.937219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62c60b99-ab0a-456b-9725-c4c328b69efb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:27.938074 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62c60b99-ab0a-456b-9725-c4c328b69efb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:27.939531 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62c60b99-ab0a-456b-9725-c4c328b69efb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:27.940252 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62c60b99-ab0a-456b-9725-c4c328b69efb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:27.955831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-771f5c4d-1f4d-4ba3-b343-83c12cc70eac tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:27.980441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-771f5c4d-1f4d-4ba3-b343-83c12cc70eac tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:27.982185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-771f5c4d-1f4d-4ba3-b343-83c12cc70eac tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:27.983093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-771f5c4d-1f4d-4ba3-b343-83c12cc70eac tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:28.059983 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-62c60b99-ab0a-456b-9725-c4c328b69efb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 0.136862 Nov 25 08:41:28.060640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 82/170] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:27 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:28.109151 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-771f5c4d-1f4d-4ba3-b343-83c12cc70eac tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 0.200973 Nov 25 08:41:28.110508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 89/171] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:27 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:28.327299 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-35a35b89-6ae6-489c-860a-411db34478fc req-885230e4-4ac9-4a24-8bf6-2e63ca018285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b638eccc-32ee-4e24-9edf-bc56e35b583b", "name": "network-vif-deleted", "tag": "1358b6a2-0117-48f3-aa89-1b23f046552a"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:28.331238 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:28.331238 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:41:28.350036 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-35a35b89-6ae6-489c-860a-411db34478fc req-885230e4-4ac9-4a24-8bf6-2e63ca018285 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:28.350484 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-35a35b89-6ae6-489c-860a-411db34478fc req-885230e4-4ac9-4a24-8bf6-2e63ca018285 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:28.364522 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-35a35b89-6ae6-489c-860a-411db34478fc req-885230e4-4ac9-4a24-8bf6-2e63ca018285 service nova] Creating event network-vif-deleted:1358b6a2-0117-48f3-aa89-1b23f046552a for instance b638eccc-32ee-4e24-9edf-bc56e35b583b on hv-cinder-77819 Nov 25 08:41:28.370596 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-35a35b89-6ae6-489c-860a-411db34478fc req-885230e4-4ac9-4a24-8bf6-2e63ca018285 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052293 Nov 25 08:41:28.376394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 83/172] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:28.460616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:28.461748 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:28.477296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:28.478300 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:28.479475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:28.480339 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:28.529219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:28.531630 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:28.560671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:28.561628 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:28.567823 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:28.568592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:28.789918 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:28.800931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-253a96b6-69e1-4acc-923b-de6f4cf722a0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.344554 Nov 25 08:41:28.804509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 90/173] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:28 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:28.906315 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:28.920410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2ad621f8-95a1-4eec-8d2e-3fd349fce949 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.394875 Nov 25 08:41:28.923748 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 84/174] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:28 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:28.939442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:28.955455 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:28.970910 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:28.971412 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:28.972435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:28.973059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.062675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.063210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.064185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lazy-loading 'fault' on Instance uuid b638eccc-32ee-4e24-9edf-bc56e35b583b {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:41:29.113964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-32aaeeda-6afa-43bf-8be4-bbe0f154d645 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Action: 'create', calling method: .version_select at 0x7f97088aea60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-739661517"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:29.134667 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546e3cad06d1448487f92b68b8530e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa0e4df2f4476cb61baa83f9e3c6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:29.147526 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4c8cb72e-34b2-4f32-a0f9-d3c072d67821 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 200 len: 1350 microversion: 2.1 time: 0.219137 Nov 25 08:41:29.150153 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 85/175] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:28 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 1350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:29.154720 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-32aaeeda-6afa-43bf-8be4-bbe0f154d645 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:41:29.155636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d6482432-6d8e-43ba-9763-39523e01c445 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:29.156706 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d6482432-6d8e-43ba-9763-39523e01c445 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:29.160083 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-32aaeeda-6afa-43bf-8be4-bbe0f154d645 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for user 16a2f54eb10148c48a3cdd2641da5315 and project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:41:29.164042 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6482432-6d8e-43ba-9763-39523e01c445 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.164587 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6482432-6d8e-43ba-9763-39523e01c445 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.166165 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6482432-6d8e-43ba-9763-39523e01c445 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.166797 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6482432-6d8e-43ba-9763-39523e01c445 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.266674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d6482432-6d8e-43ba-9763-39523e01c445 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 0.114946 Nov 25 08:41:29.268344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 86/176] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:29 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:29.280229 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1369b841-d619-41be-bd06-29a5944b2c6f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:29.281242 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1369b841-d619-41be-bd06-29a5944b2c6f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:29.288837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1369b841-d619-41be-bd06-29a5944b2c6f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.289561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1369b841-d619-41be-bd06-29a5944b2c6f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.290471 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1369b841-d619-41be-bd06-29a5944b2c6f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.291991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1369b841-d619-41be-bd06-29a5944b2c6f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.401380 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1369b841-d619-41be-bd06-29a5944b2c6f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 0.131223 Nov 25 08:41:29.403450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 87/177] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:29 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:29.475012 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-32aaeeda-6afa-43bf-8be4-bbe0f154d645 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:41:29.482562 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-32aaeeda-6afa-43bf-8be4-bbe0f154d645 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for user 16a2f54eb10148c48a3cdd2641da5315 and project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:41:29.501343 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-32aaeeda-6afa-43bf-8be4-bbe0f154d645 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.695339 Nov 25 08:41:29.502015 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 91/178] 10.222.0.46 () {60 vars in 1157 bytes} [Thu Nov 25 08:41:28 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:29.829690 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:29.830395 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:29.838001 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.838457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.839259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.840331 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.939921 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:29.940985 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:29.957224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.957670 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:29.958649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:29.959258 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.076479 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:30.088050 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c9413431-e83f-4df7-bd6f-7547986a775c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.261740 Nov 25 08:41:30.092291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 88/179] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:29 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:30.166175 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:30.166787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:30.176132 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.176770 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.177691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.178247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.193631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] HTTP exception thrown: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. Nov 25 08:41:30.194825 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Returning 404 to user: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:30.195602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d32c22bf-88ad-490b-9399-e184221526bd tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 404 len: 111 microversion: 2.1 time: 0.033183 Nov 25 08:41:30.196325 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 89/180] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:30 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:41:30.279673 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e8af9fdd-1d7a-4e67-80c8-26e433649405 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:30.281111 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e8af9fdd-1d7a-4e67-80c8-26e433649405 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:30.289674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8af9fdd-1d7a-4e67-80c8-26e433649405 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.290122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8af9fdd-1d7a-4e67-80c8-26e433649405 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.290942 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8af9fdd-1d7a-4e67-80c8-26e433649405 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.291463 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8af9fdd-1d7a-4e67-80c8-26e433649405 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.421515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:30.432120 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c47dfc10-d692-47ca-9eaf-f379e829ed39 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.496428 Nov 25 08:41:30.432705 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 92/181] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:29 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:30.437730 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:30.438708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:30.444572 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.445021 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.445815 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.446251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.459728 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] HTTP exception thrown: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. Nov 25 08:41:30.460327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Returning 404 to user: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:30.461157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-538e4d6a-9be4-461d-a2e1-512d9e5ae315 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027007 Nov 25 08:41:30.461710 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 93/182] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:41:30 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:41:30.466934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-10cf134c-e014-4494-afe0-fad693a60f92 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:30.468174 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-10cf134c-e014-4494-afe0-fad693a60f92 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:30.474111 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-10cf134c-e014-4494-afe0-fad693a60f92 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.474566 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-10cf134c-e014-4494-afe0-fad693a60f92 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:30.475416 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-10cf134c-e014-4494-afe0-fad693a60f92 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:30.476072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-10cf134c-e014-4494-afe0-fad693a60f92 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:33.492837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e8af9fdd-1d7a-4e67-80c8-26e433649405 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 3.217685 Nov 25 08:41:33.498945 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 90/183] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:30 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 3225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 25 08:41:33.507471 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:33.508430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:33.518970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:33.519750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:33.525786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-10cf134c-e014-4494-afe0-fad693a60f92 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 3.062670 Nov 25 08:41:33.526531 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:33.527766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:33.528988 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 94/184] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:30 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 3066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:33.534798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:33.535611 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:33.544319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:33.544919 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:33.545941 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:33.546676 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:33.822002 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:33.833005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:33.840908 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-daf5d468-ec9c-49ed-aa60-0872c6a22c67 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.339698 Nov 25 08:41:33.841524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 91/185] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:33 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:33.842365 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ec560ddb-c7b8-4238-b577-4b1860c0fabe tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.311902 Nov 25 08:41:33.852087 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 95/186] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:33 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:34.504570 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9fe9771f-e1d2-4fb4-b58a-5dfcf8bc910b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:34.505495 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9fe9771f-e1d2-4fb4-b58a-5dfcf8bc910b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:34.514479 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe9771f-e1d2-4fb4-b58a-5dfcf8bc910b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.514850 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe9771f-e1d2-4fb4-b58a-5dfcf8bc910b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:34.515789 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe9771f-e1d2-4fb4-b58a-5dfcf8bc910b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.516111 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe9771f-e1d2-4fb4-b58a-5dfcf8bc910b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:34.538616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a40f836d-2667-4089-9496-e5d750aed1a9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:34.539425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a40f836d-2667-4089-9496-e5d750aed1a9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:34.551062 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40f836d-2667-4089-9496-e5d750aed1a9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.551536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40f836d-2667-4089-9496-e5d750aed1a9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:34.552363 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40f836d-2667-4089-9496-e5d750aed1a9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.552826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40f836d-2667-4089-9496-e5d750aed1a9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:34.601296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9fe9771f-e1d2-4fb4-b58a-5dfcf8bc910b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 0.100190 Nov 25 08:41:34.602623 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 92/187] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:34 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:34.637534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a40f836d-2667-4089-9496-e5d750aed1a9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 0.101257 Nov 25 08:41:34.639295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 96/188] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:34 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:34.864805 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:34.865539 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:34.866547 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:34.866721 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:34.879589 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.879973 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.880278 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:34.880616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:34.881632 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.881790 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:34.882371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:34.882708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.102409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:35.110601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6b5ffcba-9f2f-4a76-bac9-63e6597b4e72 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.251709 Nov 25 08:41:35.111183 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 97/189] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:34 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:35.119965 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:35.121068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:35.137983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.138427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.139277 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.139672 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.140222 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:35.154592 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] HTTP exception thrown: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. Nov 25 08:41:35.155256 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Returning 404 to user: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:35.156175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e2e84019-ab6a-4850-bc7a-a15382af5c96 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 404 len: 111 microversion: 2.1 time: 0.044010 Nov 25 08:41:35.156794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 98/190] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:41:35 2021] DELETE /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:41:35.159422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4f531991-a33f-4d94-8f38-b16c84fcf378 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.302429 Nov 25 08:41:35.163918 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 93/191] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:34 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:35.165030 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:35.165854 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] [instance: b638eccc-32ee-4e24-9edf-bc56e35b583b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:35.173132 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.173655 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.174515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.175008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.190713 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] HTTP exception thrown: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. Nov 25 08:41:35.191418 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] Returning 404 to user: Instance b638eccc-32ee-4e24-9edf-bc56e35b583b could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:35.192368 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5e0df6c4-9bfe-47ca-8885-0ad7b1728949 tempest-DeleteServersTestJSON-1184471177 tempest-DeleteServersTestJSON-1184471177-project] 10.222.0.46 "GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b" status: 404 len: 111 microversion: 2.1 time: 0.031032 Nov 25 08:41:35.192933 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 99/192] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:35 2021] GET /compute/v2.1/servers/b638eccc-32ee-4e24-9edf-bc56e35b583b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:41:35.614011 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-44ca4ca7-c611-4520-89c9-490fb912a8f5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:35.615604 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-44ca4ca7-c611-4520-89c9-490fb912a8f5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:35.625966 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca7-c611-4520-89c9-490fb912a8f5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.626651 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca7-c611-4520-89c9-490fb912a8f5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.628040 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca7-c611-4520-89c9-490fb912a8f5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.628772 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-44ca4ca7-c611-4520-89c9-490fb912a8f5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.654913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9b165385-ee03-48df-8b80-d88df6d403a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:35.659473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9b165385-ee03-48df-8b80-d88df6d403a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:35.681597 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9b165385-ee03-48df-8b80-d88df6d403a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.682421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9b165385-ee03-48df-8b80-d88df6d403a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.684576 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9b165385-ee03-48df-8b80-d88df6d403a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.685478 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9b165385-ee03-48df-8b80-d88df6d403a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.731414 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-44ca4ca7-c611-4520-89c9-490fb912a8f5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 14 microversion: 2.1 time: 0.122294 Nov 25 08:41:35.734050 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 94/193] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:35 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:35.783128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-2b5bff68-ea11-41b1-b256-fb0f236d5e96 req-d95238a9-0eee-4020-8348-e51ce82a7f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bea85b-e08a-4c45-9bc6-b587de1413a5", "name": "network-vif-plugged", "status": "completed", "tag": "3d904caf-5740-4806-9e49-0bff89308ad2"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:35.785026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:35.785026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:41:35.788056 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9b165385-ee03-48df-8b80-d88df6d403a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 14 microversion: 2.20 time: 0.142711 Nov 25 08:41:35.793353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 100/194] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:35 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:35.797948 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-2b5bff68-ea11-41b1-b256-fb0f236d5e96 req-d95238a9-0eee-4020-8348-e51ce82a7f68 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:35.798392 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-2b5bff68-ea11-41b1-b256-fb0f236d5e96 req-d95238a9-0eee-4020-8348-e51ce82a7f68 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:35.813841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-2b5bff68-ea11-41b1-b256-fb0f236d5e96 req-d95238a9-0eee-4020-8348-e51ce82a7f68 service nova] Creating event network-vif-plugged:3d904caf-5740-4806-9e49-0bff89308ad2 for instance 80bea85b-e08a-4c45-9bc6-b587de1413a5 on hv-cinder-77819 Nov 25 08:41:35.820213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-2b5bff68-ea11-41b1-b256-fb0f236d5e96 req-d95238a9-0eee-4020-8348-e51ce82a7f68 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043161 Nov 25 08:41:35.821592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 95/195] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:36.132319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:36.133189 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:36.143002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.143455 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.144276 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.144915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.184231 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:36.184231 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:36.192895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.193679 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.194477 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.194919 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.366182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:36.382621 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-31900038-c066-4fc4-88ab-4ca135611636 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.255034 Nov 25 08:41:36.384185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 101/196] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:36 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:36.419272 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:36.436128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-001a6d46-cfc5-4719-b241-5451c8aeb19a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.258661 Nov 25 08:41:36.447956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 96/197] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:36 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:36.750315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-df230420-2f1e-43c0-87ff-8028dbfbabc1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:36.754213 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-df230420-2f1e-43c0-87ff-8028dbfbabc1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:36.782498 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df230420-2f1e-43c0-87ff-8028dbfbabc1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.783169 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df230420-2f1e-43c0-87ff-8028dbfbabc1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.784555 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df230420-2f1e-43c0-87ff-8028dbfbabc1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.785279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-df230420-2f1e-43c0-87ff-8028dbfbabc1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.805043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6b7862d8-9b0a-4388-9de1-fac5876dccaa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:36.810138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6b7862d8-9b0a-4388-9de1-fac5876dccaa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:36.830766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b7862d8-9b0a-4388-9de1-fac5876dccaa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.832051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b7862d8-9b0a-4388-9de1-fac5876dccaa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.838186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b7862d8-9b0a-4388-9de1-fac5876dccaa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:36.839171 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b7862d8-9b0a-4388-9de1-fac5876dccaa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:36.945542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-df230420-2f1e-43c0-87ff-8028dbfbabc1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 4298 microversion: 2.1 time: 0.202824 Nov 25 08:41:36.946465 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 102/198] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:36 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 4298 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:37.013615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6b7862d8-9b0a-4388-9de1-fac5876dccaa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 5186 microversion: 2.20 time: 0.216303 Nov 25 08:41:37.014398 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 97/199] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:36 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 5186 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:37.407751 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:37.408453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:37.418551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:37.419027 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:37.421457 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:37.421457 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:37.467761 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:37.468931 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:37.480262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:37.481171 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:37.482497 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:37.483230 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:37.614635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:37.623858 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b0562d98-7f1a-48a5-a1a5-fbe961158752 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1317 microversion: 2.1 time: 0.222224 Nov 25 08:41:37.624686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 103/200] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:37 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:37.692163 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:37.705806 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-836e5d7c-59df-4e00-94fc-76174f003d50 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.244277 Nov 25 08:41:37.706917 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 98/201] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:37 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:37.766404 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fa66d6ea-63d9-4bc2-af58-8c2f957a1586 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Action: 'create', calling method: .version_select at 0x7f9708899a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1957627140"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:37.959887 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-776630ba-9c7a-4cd9-bc89-5a8b28882e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:37.962436 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-776630ba-9c7a-4cd9-bc89-5a8b28882e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:37.978225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-776630ba-9c7a-4cd9-bc89-5a8b28882e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:37.978736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-776630ba-9c7a-4cd9-bc89-5a8b28882e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:37.980359 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-776630ba-9c7a-4cd9-bc89-5a8b28882e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:37.981148 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-776630ba-9c7a-4cd9-bc89-5a8b28882e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.083470 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-776630ba-9c7a-4cd9-bc89-5a8b28882e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 8058 microversion: 2.1 time: 0.129270 Nov 25 08:41:38.084149 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 99/202] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:37 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 8058 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:38.090428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6449ead3-fe41-440a-8e71-7f5d2d7bc5d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:38.091712 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6449ead3-fe41-440a-8e71-7f5d2d7bc5d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:38.100275 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6449ead3-fe41-440a-8e71-7f5d2d7bc5d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.100874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6449ead3-fe41-440a-8e71-7f5d2d7bc5d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.101812 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6449ead3-fe41-440a-8e71-7f5d2d7bc5d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.102435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6449ead3-fe41-440a-8e71-7f5d2d7bc5d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.142648 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fa66d6ea-63d9-4bc2-af58-8c2f957a1586 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.516456 Nov 25 08:41:38.143395 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 104/203] 10.222.0.46 () {60 vars in 1154 bytes} [Thu Nov 25 08:41:37 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 518 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 25 08:41:38.155020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-be5a72a0-cbb0-42c1-a86e-8f462f216b29 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f97088c6940>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:38.204928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-be5a72a0-cbb0-42c1-a86e-8f462f216b29 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9" status: 200 len: 345 microversion: 2.1 time: 0.054513 Nov 25 08:41:38.205552 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 105/204] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:41:38 2021] GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:41:38.223316 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6449ead3-fe41-440a-8e71-7f5d2d7bc5d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 8562 microversion: 2.20 time: 0.137327 Nov 25 08:41:38.224013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 100/205] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:38 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 8562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:41:38.649826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:38.650507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:38.657102 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.657606 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.658568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.659005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.722943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:38.724289 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:38.732532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.732984 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.733790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.734232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.823872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:38.836717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fa5ff396-2fea-41e9-bcb3-47c95d654b4f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1506 microversion: 2.1 time: 0.190864 Nov 25 08:41:38.847753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 106/206] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:38 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:38.856012 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c9947b1-a993-4fa9-9a26-6a13399636b6"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:38.857222 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:38.864220 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.864651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.865472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:38.865904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:38.952590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] HTTP exception thrown: Invalid volume: volume 5c9947b1-a993-4fa9-9a26-6a13399636b6 is already attached to instances: 05f3bf22-bb61-4897-986f-99ae94f9fb33 Nov 25 08:41:38.953426 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Returning 400 to user: Invalid volume: volume 5c9947b1-a993-4fa9-9a26-6a13399636b6 is already attached to instances: 05f3bf22-bb61-4897-986f-99ae94f9fb33 {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:38.954541 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-26b87032-7f8b-4e5f-b2c1-d38cb95970db tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103067 Nov 25 08:41:38.955122 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 107/207] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:41:38 2021] POST /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 25 08:41:39.026967 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:39.028981 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:39.029989 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:39.035092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-284b765b-058b-495c-9640-7ed05191b5a5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.316341 Nov 25 08:41:39.039600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 101/208] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:38 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:39.039761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.040422 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.041719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.043067 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.097346 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8342e1a9-7178-4324-9ab2-d2c72da7b6b9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:39.098912 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8342e1a9-7178-4324-9ab2-d2c72da7b6b9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:39.109079 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8342e1a9-7178-4324-9ab2-d2c72da7b6b9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.109821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8342e1a9-7178-4324-9ab2-d2c72da7b6b9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.111144 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8342e1a9-7178-4324-9ab2-d2c72da7b6b9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.111905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8342e1a9-7178-4324-9ab2-d2c72da7b6b9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.201320 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lazy-loading 'services' on Instance uuid 05f3bf22-bb61-4897-986f-99ae94f9fb33 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:41:39.231788 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8342e1a9-7178-4324-9ab2-d2c72da7b6b9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 10893 microversion: 2.1 time: 0.140514 Nov 25 08:41:39.233298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 102/209] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:39 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 10893 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:39.244209 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b6256a0b-8f9b-4837-87fe-af498cd2fc60 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f970925bdc0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:39.334563 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b6256a0b-8f9b-4837-87fe-af498cd2fc60 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9" status: 200 len: 346 microversion: 2.1 time: 0.099211 Nov 25 08:41:39.335269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 103/210] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:41:39 2021] GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:39.345030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8e0c68f8-9cfe-4a6d-b69f-5b6c11969a4c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:39.346827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8e0c68f8-9cfe-4a6d-b69f-5b6c11969a4c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:39.357418 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e0c68f8-9cfe-4a6d-b69f-5b6c11969a4c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.358038 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e0c68f8-9cfe-4a6d-b69f-5b6c11969a4c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.359778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e0c68f8-9cfe-4a6d-b69f-5b6c11969a4c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.360419 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e0c68f8-9cfe-4a6d-b69f-5b6c11969a4c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.360613 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1b636225-1eb6-426f-8f27-1c9e4c1250f2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments/5c9947b1-a993-4fa9-9a26-6a13399636b6" status: 202 len: 0 microversion: 2.1 time: 0.337128 Nov 25 08:41:39.361490 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 108/211] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:41:39 2021] DELETE /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments/5c9947b1-a993-4fa9-9a26-6a13399636b6 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:39.369076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-31baddbf-ed40-463b-8a95-74fb09574dab tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Action: 'create', calling method: .version_select at 0x7f97089611f0>, body: {"snapshot": {"volume_id": "87cbf6a3-3ac1-4645-b8df-a1414a02dfc9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-141124184"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:39.531165 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8e0c68f8-9cfe-4a6d-b69f-5b6c11969a4c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 12093 microversion: 2.20 time: 0.194115 Nov 25 08:41:39.532139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 104/212] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:39 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 12093 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:39.537537 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-68718716-22a6-4913-9352-f1c686102704 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:39.538629 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-68718716-22a6-4913-9352-f1c686102704 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:39.550720 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-68718716-22a6-4913-9352-f1c686102704 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.552205 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-68718716-22a6-4913-9352-f1c686102704 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.553170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-68718716-22a6-4913-9352-f1c686102704 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:39.553488 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-68718716-22a6-4913-9352-f1c686102704 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:39.570268 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-31baddbf-ed40-463b-8a95-74fb09574dab tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.206448 Nov 25 08:41:39.578387 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 109/213] 10.222.0.46 () {60 vars in 1161 bytes} [Thu Nov 25 08:41:39 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:39.584979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3f423202-d156-4f95-a09b-0ae1c2189182 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f970889a4c0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:39.598689 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-68718716-22a6-4913-9352-f1c686102704 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065111 Nov 25 08:41:39.599278 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 105/214] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:41:39 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:39.654766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3f423202-d156-4f95-a09b-0ae1c2189182 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692" status: 200 len: 286 microversion: 2.1 time: 0.074350 Nov 25 08:41:39.655895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 110/215] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Nov 25 08:41:39 2021] GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:39.665880 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-88d3d19a-f55b-4bda-941a-63ede986bbe7 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9708845d30>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:39.712881 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-88d3d19a-f55b-4bda-941a-63ede986bbe7 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.050549 Nov 25 08:41:39.713498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 106/216] 10.222.0.46 () {58 vars in 1139 bytes} [Thu Nov 25 08:41:39 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:39.724678 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-81e966a0-e365-47f7-9904-bb1d07236727 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f97089613a0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:39.758512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-81e966a0-e365-47f7-9904-bb1d07236727 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692" status: 200 len: 286 microversion: 2.1 time: 0.038618 Nov 25 08:41:39.759081 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 111/217] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Nov 25 08:41:39 2021] GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:40.055745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:40.056787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:40.065589 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:40.066035 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:40.066820 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:40.067254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:40.249711 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:40.252218 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6a1d875e-97df-4d7a-902b-eef2ef767b93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:40.255462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6a1d875e-97df-4d7a-902b-eef2ef767b93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:40.263680 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a1d875e-97df-4d7a-902b-eef2ef767b93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:40.264350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fe6a49b8-6a95-4dd5-8974-b2fa6f80528c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.213145 Nov 25 08:41:40.264591 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a1d875e-97df-4d7a-902b-eef2ef767b93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:40.265506 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 107/218] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:40 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:40.266262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a1d875e-97df-4d7a-902b-eef2ef767b93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:40.267101 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a1d875e-97df-4d7a-902b-eef2ef767b93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:40.542667 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-88f145a9-ae07-4702-b853-61bb9dfc1239 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:40.543697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-88f145a9-ae07-4702-b853-61bb9dfc1239 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:40.550394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-88f145a9-ae07-4702-b853-61bb9dfc1239 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:40.550835 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-88f145a9-ae07-4702-b853-61bb9dfc1239 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:40.551646 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-88f145a9-ae07-4702-b853-61bb9dfc1239 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:40.552083 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-88f145a9-ae07-4702-b853-61bb9dfc1239 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:43.685827 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6a1d875e-97df-4d7a-902b-eef2ef767b93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 17781 microversion: 2.1 time: 3.442343 Nov 25 08:41:43.686469 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 112/219] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:40 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 17781 bytes in 3444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:41:43.691445 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-78b7da9a-313b-40e8-84d4-ede974514831 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:43.692523 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-78b7da9a-313b-40e8-84d4-ede974514831 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:43.700842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78b7da9a-313b-40e8-84d4-ede974514831 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:43.701289 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78b7da9a-313b-40e8-84d4-ede974514831 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:43.702082 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78b7da9a-313b-40e8-84d4-ede974514831 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:43.702515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78b7da9a-313b-40e8-84d4-ede974514831 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:43.737488 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-88f145a9-ae07-4702-b853-61bb9dfc1239 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 17717 microversion: 2.20 time: 3.198368 Nov 25 08:41:43.742138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 108/220] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:40 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 17717 bytes in 3201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:43.746585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-39cb7006-228d-4cdb-a13b-7ca428e7ff67 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f97088f1670>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:43.787846 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-39cb7006-228d-4cdb-a13b-7ca428e7ff67 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692" status: 200 len: 286 microversion: 2.1 time: 0.047012 Nov 25 08:41:43.788574 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 109/221] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Nov 25 08:41:43 2021] GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:43.794224 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:43.796019 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:43.803273 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:43.803915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:43.804822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:43.805293 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:43.883425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-78b7da9a-313b-40e8-84d4-ede974514831 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194892 Nov 25 08:41:43.883425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 113/222] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:41:43 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:43.954129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:43.962373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b921fe2d-a7fb-4ae5-8d7b-3bde13c06fde tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.172652 Nov 25 08:41:43.962938 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 110/223] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:43 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:44.699374 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-598b4ae1-6c1c-4e2b-bade-773a4fe412c4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:44.700328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-598b4ae1-6c1c-4e2b-bade-773a4fe412c4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:44.707418 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-598b4ae1-6c1c-4e2b-bade-773a4fe412c4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.707963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-598b4ae1-6c1c-4e2b-bade-773a4fe412c4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:44.708742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-598b4ae1-6c1c-4e2b-bade-773a4fe412c4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.709182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-598b4ae1-6c1c-4e2b-bade-773a4fe412c4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:44.750084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a73452bd-573f-424d-9213-38e74b04cfb7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:44.751016 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a73452bd-573f-424d-9213-38e74b04cfb7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:44.757564 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a73452bd-573f-424d-9213-38e74b04cfb7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.758007 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a73452bd-573f-424d-9213-38e74b04cfb7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:44.758795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a73452bd-573f-424d-9213-38e74b04cfb7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.759227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a73452bd-573f-424d-9213-38e74b04cfb7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:44.805419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-598b4ae1-6c1c-4e2b-bade-773a4fe412c4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 18029 microversion: 2.1 time: 0.111547 Nov 25 08:41:44.806348 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 114/224] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:44 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 18029 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:44.814582 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-170bcdce-5518-4d61-9d99-ab9f35deb696 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9709219940>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:44.845375 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-170bcdce-5518-4d61-9d99-ab9f35deb696 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692" status: 200 len: 287 microversion: 2.1 time: 0.036459 Nov 25 08:41:44.846048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 115/225] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Nov 25 08:41:44 2021] GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:44.858716 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-002a08de-c29f-4ae2-9adf-f7a89239d057 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9708880700>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:44.863059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a73452bd-573f-424d-9213-38e74b04cfb7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 18777 microversion: 2.20 time: 0.116502 Nov 25 08:41:44.863819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 111/226] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:44 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 18777 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:41:44.897819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a0d54b3d-ad6f-46ed-94d5-6d3b96da9d76 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:44.899062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a0d54b3d-ad6f-46ed-94d5-6d3b96da9d76 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:44.911585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0d54b3d-ad6f-46ed-94d5-6d3b96da9d76 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.912048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0d54b3d-ad6f-46ed-94d5-6d3b96da9d76 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:44.912888 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0d54b3d-ad6f-46ed-94d5-6d3b96da9d76 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.913349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0d54b3d-ad6f-46ed-94d5-6d3b96da9d76 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:44.928719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-002a08de-c29f-4ae2-9adf-f7a89239d057 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692" status: 202 len: 0 microversion: 2.1 time: 0.075517 Nov 25 08:41:44.931133 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 116/227] 10.222.0.46 () {58 vars in 1253 bytes} [Thu Nov 25 08:41:44 2021] DELETE /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:44.947502 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-408d2df0-a628-4c34-b121-954e434d0a78 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9708899280>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:44.959703 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a0d54b3d-ad6f-46ed-94d5-6d3b96da9d76 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064973 Nov 25 08:41:44.966003 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 112/228] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:41:44 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:41:44.980117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:44.980940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:44.987990 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.988489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:44.989328 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:44.989690 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:45.019301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-408d2df0-a628-4c34-b121-954e434d0a78 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692" status: 200 len: 286 microversion: 2.1 time: 0.079413 Nov 25 08:41:45.019301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 117/229] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Nov 25 08:41:44 2021] GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:45.161382 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-183436389", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "0ddee4b4-d930-497a-91bb-d464076fa1b3"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:45.179675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:45.188072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cbb04461-a4db-4bbe-ae81-8b0337397332 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.212595 Nov 25 08:41:45.188657 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 113/230] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:44 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:45.222785 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] validate_networks() for [('0ddee4b4-d930-497a-91bb-d464076fa1b3', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:41:45.630903 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:41:45.631327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:41:45.631834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:41:45.632266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:41:45.632673 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:41:45.642420 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:45.642897 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:45.643737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:45.644184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:45.663534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:41:45.668147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for user c150bf72536c4fc3bb247e9cbb9e1b45 and project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:41:45.680691 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:41:45.683150 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:41:45.728618 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cfd1e899-6178-44c8-9962-85fe7a4373a5 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571717 Nov 25 08:41:45.729891 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 118/231] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:41:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 25 08:41:45.739013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1ed69830-cfa9-49aa-9e97-d6505e8e3eda tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:45.739661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1ed69830-cfa9-49aa-9e97-d6505e8e3eda tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:45.795758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1ed69830-cfa9-49aa-9e97-d6505e8e3eda tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:45.803423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1ed69830-cfa9-49aa-9e97-d6505e8e3eda tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1217 microversion: 2.1 time: 0.067898 Nov 25 08:41:45.804069 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 114/232] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:45 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:45.817791 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-890970aa-0f48-42c2-9ab2-5131c2ddcbba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:45.818847 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-890970aa-0f48-42c2-9ab2-5131c2ddcbba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:45.826743 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-890970aa-0f48-42c2-9ab2-5131c2ddcbba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:45.827462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-890970aa-0f48-42c2-9ab2-5131c2ddcbba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:45.828544 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-890970aa-0f48-42c2-9ab2-5131c2ddcbba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:45.829222 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-890970aa-0f48-42c2-9ab2-5131c2ddcbba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:45.875242 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d6c04880-1f97-4e49-afc2-1ac810cff62c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:45.876270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d6c04880-1f97-4e49-afc2-1ac810cff62c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:45.883787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c04880-1f97-4e49-afc2-1ac810cff62c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:45.884234 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c04880-1f97-4e49-afc2-1ac810cff62c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:45.885017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c04880-1f97-4e49-afc2-1ac810cff62c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:45.886144 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c04880-1f97-4e49-afc2-1ac810cff62c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:45.918790 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-890970aa-0f48-42c2-9ab2-5131c2ddcbba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 19562 microversion: 2.1 time: 0.104732 Nov 25 08:41:45.919635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 119/233] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:45 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 19562 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:45.979745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d6c04880-1f97-4e49-afc2-1ac810cff62c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 20074 microversion: 2.20 time: 0.108691 Nov 25 08:41:45.981023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 115/234] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:45 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 20074 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:41:46.033901 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7a8e365c-0752-4987-9531-882947e8c2e5 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9708880d30>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:46.073034 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-7a8e365c-0752-4987-9531-882947e8c2e5 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] HTTP exception thrown: Snapshot 35d2665a-2ac4-46b5-8671-d05891dac692 could not be found. Nov 25 08:41:46.074460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7a8e365c-0752-4987-9531-882947e8c2e5 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Returning 404 to user: Snapshot 35d2665a-2ac4-46b5-8671-d05891dac692 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:46.075303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7a8e365c-0752-4987-9531-882947e8c2e5 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692" status: 404 len: 111 microversion: 2.1 time: 0.045532 Nov 25 08:41:46.079575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 120/235] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Nov 25 08:41:46 2021] GET /compute/v2.1/os-snapshots/35d2665a-2ac4-46b5-8671-d05891dac692 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:41:46.085312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-42a8afd7-0338-4e20-a338-ebf93d11bde6 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9708845ca0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:46.161609 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-42a8afd7-0338-4e20-a338-ebf93d11bde6 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9" status: 202 len: 0 microversion: 2.1 time: 0.080583 Nov 25 08:41:46.162161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 116/236] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Nov 25 08:41:46 2021] DELETE /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:41:46.172587 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7187668c-1312-458e-9602-abce234a0ad8 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9709219280>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:46.207926 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:46.209903 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:46.220661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:46.221390 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:46.222352 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:46.223047 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:46.235539 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7187668c-1312-458e-9602-abce234a0ad8 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9" status: 200 len: 345 microversion: 2.1 time: 0.067451 Nov 25 08:41:46.236237 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 121/237] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:41:46 2021] GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:46.427545 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:46.437607 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-81512d0e-4720-413d-9d45-764fab36c5b8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.235142 Nov 25 08:41:46.438212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 117/238] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:46 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:46.824879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:46.829403 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:46.833303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:46.834170 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:46.834997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:46.835433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:46.907478 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:46.915875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-25472934-f0f7-4335-bd72-5c8b8e2739fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1269 microversion: 2.1 time: 0.098647 Nov 25 08:41:46.916740 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 122/239] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:46 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:46.931520 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f81be5df-7b7f-4058-9eed-727742e03c80 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:46.934178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f81be5df-7b7f-4058-9eed-727742e03c80 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:46.942631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f81be5df-7b7f-4058-9eed-727742e03c80 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:46.943160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f81be5df-7b7f-4058-9eed-727742e03c80 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:46.944195 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f81be5df-7b7f-4058-9eed-727742e03c80 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:46.944700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f81be5df-7b7f-4058-9eed-727742e03c80 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:46.991978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5644353b-1d2f-4a1a-8197-f3be52257272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:46.993204 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5644353b-1d2f-4a1a-8197-f3be52257272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:47.000609 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5644353b-1d2f-4a1a-8197-f3be52257272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:47.001305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5644353b-1d2f-4a1a-8197-f3be52257272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:47.002266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5644353b-1d2f-4a1a-8197-f3be52257272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:47.002866 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5644353b-1d2f-4a1a-8197-f3be52257272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:47.047076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f81be5df-7b7f-4058-9eed-727742e03c80 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 21783 microversion: 2.1 time: 0.118907 Nov 25 08:41:47.047943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 118/240] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:46 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 21783 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:47.249407 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0ac24fd4-fc97-460f-80e9-ecc2ee797f5e tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f970882daf0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:47.280787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-0ac24fd4-fc97-460f-80e9-ecc2ee797f5e tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] HTTP exception thrown: Volume 87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 could not be found. Nov 25 08:41:47.281383 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0ac24fd4-fc97-460f-80e9-ecc2ee797f5e tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Returning 404 to user: Volume 87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:47.282478 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0ac24fd4-fc97-460f-80e9-ecc2ee797f5e tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9" status: 404 len: 109 microversion: 2.1 time: 0.037662 Nov 25 08:41:47.283621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 119/241] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:41:47 2021] GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:41:47.303641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-686bd852-d156-423c-a39c-e2f7bb51fb08 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f970882e0d0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:47.333937 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-686bd852-d156-423c-a39c-e2f7bb51fb08 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] HTTP exception thrown: Volume 87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 could not be found. Nov 25 08:41:47.334533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-686bd852-d156-423c-a39c-e2f7bb51fb08 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Returning 404 to user: Volume 87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:47.335356 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-686bd852-d156-423c-a39c-e2f7bb51fb08 tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9" status: 404 len: 109 microversion: 2.1 time: 0.039543 Nov 25 08:41:47.335992 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 120/242] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Nov 25 08:41:47 2021] DELETE /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:41:47.344206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1e0c5114-749b-4691-ae79-12edbacf71cd tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Calling method '.version_select at 0x7f9709191a60>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:47.374417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-1e0c5114-749b-4691-ae79-12edbacf71cd tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] HTTP exception thrown: Volume 87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 could not be found. Nov 25 08:41:47.375175 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1e0c5114-749b-4691-ae79-12edbacf71cd tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] Returning 404 to user: Volume 87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:41:47.376778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1e0c5114-749b-4691-ae79-12edbacf71cd tempest-VolumesSnapshotsTestJSON-1585862381 tempest-VolumesSnapshotsTestJSON-1585862381-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9" status: 404 len: 109 microversion: 2.1 time: 0.036236 Nov 25 08:41:47.377683 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 121/243] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:41:47 2021] GET /compute/v2.1/os-volumes/87cbf6a3-3ac1-4645-b8df-a1414a02dfc9 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:41:47.458215 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:47.459666 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:47.472298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:47.473539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:47.476517 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:47.477268 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:47.638284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:47.645906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-77a65453-ce62-4d24-9e55-c9bce255e873 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.191763 Nov 25 08:41:47.647533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 122/244] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:47 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:47.934713 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:47.936189 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:47.943256 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:47.943990 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:47.945128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:47.945750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:48.024284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:48.034166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-497ffaff-4850-4236-bf28-bafe1a3aae1c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1275 microversion: 2.1 time: 0.104080 Nov 25 08:41:48.035458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 123/245] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:47 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1275 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:48.059786 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fa857e25-21f9-454a-8d6a-c1d907f6295a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:48.061063 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fa857e25-21f9-454a-8d6a-c1d907f6295a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:48.068749 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa857e25-21f9-454a-8d6a-c1d907f6295a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:48.069211 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa857e25-21f9-454a-8d6a-c1d907f6295a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:48.070009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa857e25-21f9-454a-8d6a-c1d907f6295a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:48.070634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa857e25-21f9-454a-8d6a-c1d907f6295a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:50.269927 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5644353b-1d2f-4a1a-8197-f3be52257272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 24636 microversion: 2.20 time: 3.281706 Nov 25 08:41:50.270577 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 123/246] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:46 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 24636 bytes in 3283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:41:50.277977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:50.278689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:50.289309 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:50.289966 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:50.297750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fa857e25-21f9-454a-8d6a-c1d907f6295a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 24627 microversion: 2.1 time: 2.242240 Nov 25 08:41:50.298436 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 124/247] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:48 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 24627 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:50.303974 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:50.304667 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:50.309835 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:50.310284 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:50.321702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:50.322147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:50.323221 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:50.329292 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:50.462263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:50.473928 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b76ce2b7-cb4a-42ab-b6bb-045a3f1e92a8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1275 microversion: 2.1 time: 0.173502 Nov 25 08:41:50.480072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 125/248] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:50 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:50.587393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:50.596649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-94909b5c-49ad-494e-b130-a2fd1d2431a9 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.324692 Nov 25 08:41:50.597615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 124/249] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:50 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:51.282936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8155edfc-4b2a-4fde-beab-6d6351af212b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:51.284515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8155edfc-4b2a-4fde-beab-6d6351af212b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:51.293700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8155edfc-4b2a-4fde-beab-6d6351af212b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.294146 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8155edfc-4b2a-4fde-beab-6d6351af212b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.295068 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8155edfc-4b2a-4fde-beab-6d6351af212b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.295506 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8155edfc-4b2a-4fde-beab-6d6351af212b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.311068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-149d33bb-7257-4764-afe9-620dc02525c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:51.312817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-149d33bb-7257-4764-afe9-620dc02525c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:51.328683 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-149d33bb-7257-4764-afe9-620dc02525c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.330025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-149d33bb-7257-4764-afe9-620dc02525c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.330873 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-149d33bb-7257-4764-afe9-620dc02525c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.332599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-149d33bb-7257-4764-afe9-620dc02525c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.457961 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-149d33bb-7257-4764-afe9-620dc02525c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 25011 microversion: 2.1 time: 0.151926 Nov 25 08:41:51.459074 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 125/250] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:51 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 25011 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:51.483664 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8155edfc-4b2a-4fde-beab-6d6351af212b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 25186 microversion: 2.20 time: 0.204610 Nov 25 08:41:51.488841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 126/251] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:51 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 25186 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:51.492966 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:51.493999 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:51.501318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.501762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.502546 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.503668 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.615138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:51.616104 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:51.623403 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.624243 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.625249 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:51.626210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:51.835286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:51.844484 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a2faad47-20f0-420b-a7e4-a078f25bcb98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.356524 Nov 25 08:41:51.845067 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 126/252] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:51 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:51.936785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:51.946353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-eabf32da-023e-4ca9-ad39-34b45bf91689 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.335120 Nov 25 08:41:51.958180 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 127/253] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:51 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:51.997351 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-0c72a314-b6b0-4284-b981-2bdd33c19932 req-37895f75-8a9c-4976-a40c-1ea0016ee4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6594bd69-10bc-4a9f-a5d8-9c110620ed10", "tag": "f9029ad7-c8b8-4982-81e2-c65eb84cab9b"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:52.003658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:41:52.003658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:41:52.019114 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-0c72a314-b6b0-4284-b981-2bdd33c19932 req-37895f75-8a9c-4976-a40c-1ea0016ee4f4 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.019661 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-0c72a314-b6b0-4284-b981-2bdd33c19932 req-37895f75-8a9c-4976-a40c-1ea0016ee4f4 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.031761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-0c72a314-b6b0-4284-b981-2bdd33c19932 req-37895f75-8a9c-4976-a40c-1ea0016ee4f4 service nova] Creating event network-changed:f9029ad7-c8b8-4982-81e2-c65eb84cab9b for instance 6594bd69-10bc-4a9f-a5d8-9c110620ed10 on hv-cinder-77819 Nov 25 08:41:52.036998 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-0c72a314-b6b0-4284-b981-2bdd33c19932 req-37895f75-8a9c-4976-a40c-1ea0016ee4f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044295 Nov 25 08:41:52.037734 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 127/254] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:41:52.469700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ac926f60-f088-4665-b367-19385539460c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:52.470604 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ac926f60-f088-4665-b367-19385539460c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:52.482917 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac926f60-f088-4665-b367-19385539460c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.484044 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac926f60-f088-4665-b367-19385539460c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.484845 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac926f60-f088-4665-b367-19385539460c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.485558 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac926f60-f088-4665-b367-19385539460c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.499823 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8bb08e0a-7f7c-474b-a346-4804df36e1e9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:52.500821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8bb08e0a-7f7c-474b-a346-4804df36e1e9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:52.515718 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bb08e0a-7f7c-474b-a346-4804df36e1e9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.516203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bb08e0a-7f7c-474b-a346-4804df36e1e9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.517107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bb08e0a-7f7c-474b-a346-4804df36e1e9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.517661 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bb08e0a-7f7c-474b-a346-4804df36e1e9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.626964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ac926f60-f088-4665-b367-19385539460c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 25482 microversion: 2.1 time: 0.153252 Nov 25 08:41:52.626964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 128/255] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:52 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 25482 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:52.641439 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8bb08e0a-7f7c-474b-a346-4804df36e1e9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 25614 microversion: 2.20 time: 0.148665 Nov 25 08:41:52.645742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 128/256] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:52 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 25614 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:52.862215 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:52.863378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:52.870890 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.871344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.872326 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.872811 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.966550 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:52.968262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:52.977323 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.978156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:52.979997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:52.981271 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:53.178949 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:53.190881 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-071e9d01-6e95-4227-b5e8-008469dcdf57 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.332599 Nov 25 08:41:53.202152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 129/257] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:52 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:53.258343 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:53.269184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-88372dff-8beb-48c0-bdc8-a543f4000fd8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.307936 Nov 25 08:41:53.271454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 129/258] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:52 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:53.632332 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2b629f8d-8af8-4da5-aaf2-8c7540c836ba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:53.633378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2b629f8d-8af8-4da5-aaf2-8c7540c836ba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:53.639929 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b629f8d-8af8-4da5-aaf2-8c7540c836ba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:53.640372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b629f8d-8af8-4da5-aaf2-8c7540c836ba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:53.641161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b629f8d-8af8-4da5-aaf2-8c7540c836ba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:53.641596 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b629f8d-8af8-4da5-aaf2-8c7540c836ba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:53.653671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0544b6c4-d26e-469c-b02e-cf98143153d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:53.654589 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0544b6c4-d26e-469c-b02e-cf98143153d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:53.661718 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0544b6c4-d26e-469c-b02e-cf98143153d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:53.662174 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0544b6c4-d26e-469c-b02e-cf98143153d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:53.662972 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0544b6c4-d26e-469c-b02e-cf98143153d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:53.663646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0544b6c4-d26e-469c-b02e-cf98143153d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:53.764173 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0544b6c4-d26e-469c-b02e-cf98143153d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 26001 microversion: 2.20 time: 0.114177 Nov 25 08:41:53.768497 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 130/259] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:53 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 26001 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:53.794512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2b629f8d-8af8-4da5-aaf2-8c7540c836ba tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 25900 microversion: 2.1 time: 0.165635 Nov 25 08:41:53.795155 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 130/260] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:53 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 25900 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:41:54.209943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:54.211029 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:54.221667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.221667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.221667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.223968 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.289613 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:54.290783 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:54.299888 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.300435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.301447 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.302046 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.419947 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:54.431095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-579218b3-e582-465b-a405-edbbb64e2b25 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.225346 Nov 25 08:41:54.432599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 131/261] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:54 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:54.494330 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:54.505375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-995c1999-caf8-45ae-a249-871ab178c520 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.220844 Nov 25 08:41:54.506062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 131/262] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:54 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:54.776855 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-15ba4050-a6a6-4589-85a3-2f69551591ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:54.777789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-15ba4050-a6a6-4589-85a3-2f69551591ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:54.784356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ba4050-a6a6-4589-85a3-2f69551591ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.784842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ba4050-a6a6-4589-85a3-2f69551591ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.785787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ba4050-a6a6-4589-85a3-2f69551591ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.786285 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15ba4050-a6a6-4589-85a3-2f69551591ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.806481 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-262e1f9d-688a-4277-b86d-6b5a3322a690 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:54.807736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-262e1f9d-688a-4277-b86d-6b5a3322a690 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:54.814233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-262e1f9d-688a-4277-b86d-6b5a3322a690 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.814777 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-262e1f9d-688a-4277-b86d-6b5a3322a690 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.815823 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-262e1f9d-688a-4277-b86d-6b5a3322a690 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:54.816488 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-262e1f9d-688a-4277-b86d-6b5a3322a690 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:54.902984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-15ba4050-a6a6-4589-85a3-2f69551591ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 26484 microversion: 2.20 time: 0.129882 Nov 25 08:41:54.903674 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 132/263] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:54 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 26484 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:54.922000 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-262e1f9d-688a-4277-b86d-6b5a3322a690 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 26379 microversion: 2.1 time: 0.119161 Nov 25 08:41:54.922662 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 132/264] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:54 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 26379 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:41:55.449887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:55.450585 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:55.459723 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.460234 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:55.461032 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.461478 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:55.526781 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:55.527956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:55.535304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.535790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:55.536587 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.537341 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:55.693753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:55.706031 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-64752c7c-54ac-4cce-9023-1abb2c2e53ca tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.260535 Nov 25 08:41:55.706762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 133/265] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:55 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:55.777706 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:55.788423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-aa7bbfff-3ea1-41c1-a3b6-4f9dba0ca157 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.267155 Nov 25 08:41:55.789122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 133/266] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:55 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:55.916722 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-186944ad-04d6-4afa-8c79-a0710fc0febd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:55.917821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-186944ad-04d6-4afa-8c79-a0710fc0febd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:55.924781 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-186944ad-04d6-4afa-8c79-a0710fc0febd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.925545 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-186944ad-04d6-4afa-8c79-a0710fc0febd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:55.928252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-186944ad-04d6-4afa-8c79-a0710fc0febd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.928972 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-186944ad-04d6-4afa-8c79-a0710fc0febd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:55.933546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-71f081d8-7dc9-4726-9397-3c8bc4188a77 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:55.934486 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-71f081d8-7dc9-4726-9397-3c8bc4188a77 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:55.940721 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71f081d8-7dc9-4726-9397-3c8bc4188a77 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.941275 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71f081d8-7dc9-4726-9397-3c8bc4188a77 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:55.942080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71f081d8-7dc9-4726-9397-3c8bc4188a77 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:55.942615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71f081d8-7dc9-4726-9397-3c8bc4188a77 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:56.061836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-186944ad-04d6-4afa-8c79-a0710fc0febd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 26877 microversion: 2.20 time: 0.150283 Nov 25 08:41:56.062593 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 134/267] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:55 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 26877 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:56.125282 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-71f081d8-7dc9-4726-9397-3c8bc4188a77 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 26752 microversion: 2.1 time: 0.195648 Nov 25 08:41:56.126564 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 134/268] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:55 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 26752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:41:56.732869 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:56.733772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:56.747054 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:56.748128 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:56.749407 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:56.750002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:56.806373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:56.807810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:56.815931 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:56.816428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:56.817299 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:56.817774 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:56.967789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:56.975917 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f4605054-441a-44cc-b565-3367ee774998 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.254301 Nov 25 08:41:56.976517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 135/269] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:56 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:57.058662 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:57.068004 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-16f59894-4935-44a4-9bf3-16baf48eba52 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.265488 Nov 25 08:41:57.068841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 135/270] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:56 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:41:57.074808 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fcf2167f-01a5-4d4e-afba-9179d2f725e1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:57.076125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fcf2167f-01a5-4d4e-afba-9179d2f725e1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:57.087172 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fcf2167f-01a5-4d4e-afba-9179d2f725e1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:57.087852 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fcf2167f-01a5-4d4e-afba-9179d2f725e1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:57.089288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fcf2167f-01a5-4d4e-afba-9179d2f725e1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:57.090626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fcf2167f-01a5-4d4e-afba-9179d2f725e1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:57.137466 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-671a5984-e38e-4c8b-9cbb-d5ed02205369 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:41:57.138412 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-671a5984-e38e-4c8b-9cbb-d5ed02205369 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:57.144898 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-671a5984-e38e-4c8b-9cbb-d5ed02205369 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:57.145343 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-671a5984-e38e-4c8b-9cbb-d5ed02205369 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:57.146131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-671a5984-e38e-4c8b-9cbb-d5ed02205369 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:57.146735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-671a5984-e38e-4c8b-9cbb-d5ed02205369 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:59.251151 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fcf2167f-01a5-4d4e-afba-9179d2f725e1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 27725 microversion: 2.20 time: 2.180671 Nov 25 08:41:59.251823 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 136/271] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:41:57 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 27725 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:41:59.256626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:59.257314 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:59.264364 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:59.264810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:59.265585 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:59.266014 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:59.271027 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-671a5984-e38e-4c8b-9cbb-d5ed02205369 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 27610 microversion: 2.1 time: 2.137527 Nov 25 08:41:59.271752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 136/272] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:41:57 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 27610 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:41:59.276954 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:41:59.278022 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:41:59.285614 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:59.286154 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:59.287036 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:41:59.287602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:41:59.484494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:59.489679 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:41:59.492451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-37f1617e-4cdf-40f8-90f9-ccef1dcc315d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.239354 Nov 25 08:41:59.494839 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 137/273] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:59 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:41:59.501270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-38a80714-e22c-44b9-b637-6ce0f8fb72c7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.228118 Nov 25 08:41:59.502203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 137/274] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:41:59 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:00.263409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2abeb24e-9c8b-42c4-8c89-45d34371a8f4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:00.264413 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2abeb24e-9c8b-42c4-8c89-45d34371a8f4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:00.270886 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2abeb24e-9c8b-42c4-8c89-45d34371a8f4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.271354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2abeb24e-9c8b-42c4-8c89-45d34371a8f4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.272192 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2abeb24e-9c8b-42c4-8c89-45d34371a8f4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.272632 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2abeb24e-9c8b-42c4-8c89-45d34371a8f4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.283315 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7765fc9a-3827-432a-922f-8eaf3334ab23 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:00.285654 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7765fc9a-3827-432a-922f-8eaf3334ab23 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:00.294134 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7765fc9a-3827-432a-922f-8eaf3334ab23 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.294574 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7765fc9a-3827-432a-922f-8eaf3334ab23 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.295423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7765fc9a-3827-432a-922f-8eaf3334ab23 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.296059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7765fc9a-3827-432a-922f-8eaf3334ab23 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.378334 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2abeb24e-9c8b-42c4-8c89-45d34371a8f4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28051 microversion: 2.20 time: 0.119522 Nov 25 08:42:00.379192 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 138/275] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:00 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28051 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:00.428365 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7765fc9a-3827-432a-922f-8eaf3334ab23 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 27828 microversion: 2.1 time: 0.148972 Nov 25 08:42:00.429024 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 138/276] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:00 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 27828 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:00.509794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:00.511311 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:00.518768 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:00.519087 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.519538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:00.519666 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.520425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.520875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.526202 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.526711 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.527511 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:00.527982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:00.725942 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:00.734321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-677907eb-8ff9-412b-adcf-c702ebf760a6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.228582 Nov 25 08:42:00.734904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 139/277] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:00 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:00.746101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:00.748117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-946a896b-9a9c-4f9b-ab11-5c23dcfd4a2b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.233163 Nov 25 08:42:00.748766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 139/278] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:00 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:01.392093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6d4fa72f-3133-4e06-8ed9-207c98b1e4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:01.393827 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6d4fa72f-3133-4e06-8ed9-207c98b1e4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:01.405015 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6d4fa72f-3133-4e06-8ed9-207c98b1e4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.405462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6d4fa72f-3133-4e06-8ed9-207c98b1e4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.406259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6d4fa72f-3133-4e06-8ed9-207c98b1e4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.406692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6d4fa72f-3133-4e06-8ed9-207c98b1e4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.441683 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8aec0f52-1a8f-4e94-a622-3666113a8694 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:01.443168 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8aec0f52-1a8f-4e94-a622-3666113a8694 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:01.451254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aec0f52-1a8f-4e94-a622-3666113a8694 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.451959 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aec0f52-1a8f-4e94-a622-3666113a8694 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.453187 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aec0f52-1a8f-4e94-a622-3666113a8694 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.453875 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aec0f52-1a8f-4e94-a622-3666113a8694 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.512349 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6d4fa72f-3133-4e06-8ed9-207c98b1e4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28149 microversion: 2.20 time: 0.124970 Nov 25 08:42:01.513064 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 140/279] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:01 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28149 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:01.570033 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8aec0f52-1a8f-4e94-a622-3666113a8694 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28112 microversion: 2.1 time: 0.132776 Nov 25 08:42:01.570592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 140/280] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:01 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28112 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:01.752074 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:01.752769 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:01.759531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.761359 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.762042 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.762482 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.766736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:01.767427 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:01.774151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.774838 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.775776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:01.776215 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:01.976344 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:01.980665 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:01.988337 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a7e7f2e8-6b3d-4e7a-80c7-8ab570015369 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.225791 Nov 25 08:42:01.988907 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 141/281] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:01 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:01.998689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-11c484bf-d2a8-47d6-8f0d-912e911f61f7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.240941 Nov 25 08:42:01.998689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 141/282] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:01 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:02.004470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-a2a8d22c-4152-42bc-b491-903ba00ca79d req-0f335343-ab88-40bd-a45e-1fccb8769c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6594bd69-10bc-4a9f-a5d8-9c110620ed10", "name": "network-vif-plugged", "status": "completed", "tag": "f9029ad7-c8b8-4982-81e2-c65eb84cab9b"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:02.005992 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:02.005992 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:42:02.014788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-a2a8d22c-4152-42bc-b491-903ba00ca79d req-0f335343-ab88-40bd-a45e-1fccb8769c2c service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:02.015601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-a2a8d22c-4152-42bc-b491-903ba00ca79d req-0f335343-ab88-40bd-a45e-1fccb8769c2c service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:02.030714 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-a2a8d22c-4152-42bc-b491-903ba00ca79d req-0f335343-ab88-40bd-a45e-1fccb8769c2c service nova] Creating event network-vif-plugged:f9029ad7-c8b8-4982-81e2-c65eb84cab9b for instance 6594bd69-10bc-4a9f-a5d8-9c110620ed10 on hv-cinder-77819 Nov 25 08:42:02.036801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-a2a8d22c-4152-42bc-b491-903ba00ca79d req-0f335343-ab88-40bd-a45e-1fccb8769c2c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041616 Nov 25 08:42:02.037548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 142/283] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:02.523443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d7d0a827-e865-4209-9bf3-16c82f2a1057 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:02.524399 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d7d0a827-e865-4209-9bf3-16c82f2a1057 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:02.531177 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7d0a827-e865-4209-9bf3-16c82f2a1057 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:02.531671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7d0a827-e865-4209-9bf3-16c82f2a1057 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:02.532480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7d0a827-e865-4209-9bf3-16c82f2a1057 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:02.532975 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7d0a827-e865-4209-9bf3-16c82f2a1057 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:02.582797 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1baa9d63-ff88-4dee-9c7c-f88faf9c32d0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:02.583826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1baa9d63-ff88-4dee-9c7c-f88faf9c32d0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:02.598008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1baa9d63-ff88-4dee-9c7c-f88faf9c32d0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:02.598820 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1baa9d63-ff88-4dee-9c7c-f88faf9c32d0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:02.599733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1baa9d63-ff88-4dee-9c7c-f88faf9c32d0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:02.600393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1baa9d63-ff88-4dee-9c7c-f88faf9c32d0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:02.614766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d7d0a827-e865-4209-9bf3-16c82f2a1057 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28149 microversion: 2.20 time: 0.094745 Nov 25 08:42:02.619061 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 142/284] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:02 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:42:02.685347 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1baa9d63-ff88-4dee-9c7c-f88faf9c32d0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28112 microversion: 2.1 time: 0.107048 Nov 25 08:42:02.685998 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 143/285] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:02 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28112 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:03.006581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:03.007270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:03.009949 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:03.010796 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:03.014567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.015017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.015833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.016273 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.017580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.018018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.018808 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.019255 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.213522 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:03.221171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b8bd3802-9f86-41ee-836a-08fafce381eb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1317 microversion: 2.1 time: 0.215175 Nov 25 08:42:03.221758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 144/286] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:03 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:03.221877 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:03.238945 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-41b27ed9-3885-4848-8a67-857dca0e27dd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.236236 Nov 25 08:42:03.239986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 143/287] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:03 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:03.626247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-12f7c939-94a5-4d33-8529-4ba88f80cf6c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:03.627212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-12f7c939-94a5-4d33-8529-4ba88f80cf6c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:03.636699 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12f7c939-94a5-4d33-8529-4ba88f80cf6c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.637155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12f7c939-94a5-4d33-8529-4ba88f80cf6c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.638048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12f7c939-94a5-4d33-8529-4ba88f80cf6c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.638484 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12f7c939-94a5-4d33-8529-4ba88f80cf6c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.696839 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e2973487-95d9-47ef-a687-c07992d0f767 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:03.698616 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e2973487-95d9-47ef-a687-c07992d0f767 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:03.705499 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e2973487-95d9-47ef-a687-c07992d0f767 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.705947 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e2973487-95d9-47ef-a687-c07992d0f767 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.706740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e2973487-95d9-47ef-a687-c07992d0f767 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:03.707357 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e2973487-95d9-47ef-a687-c07992d0f767 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:03.752384 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-12f7c939-94a5-4d33-8529-4ba88f80cf6c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28149 microversion: 2.20 time: 0.116457 Nov 25 08:42:03.753028 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 145/288] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:03 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28149 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:03.785337 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e2973487-95d9-47ef-a687-c07992d0f767 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28112 microversion: 2.1 time: 0.091860 Nov 25 08:42:03.790418 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 144/289] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:03 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28112 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:04.239846 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:04.240568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:04.248186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.248186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.249093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.249528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.260852 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:04.262297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:04.269294 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.269736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.270519 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.271142 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.473252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:04.477413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:04.485082 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8ca269f1-c76c-4f0c-b99e-9796427ef0bb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1506 microversion: 2.1 time: 0.248912 Nov 25 08:42:04.485972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1d316e65-a9b4-4089-9ea9-1831d75fd015 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.229141 Nov 25 08:42:04.486366 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 146/290] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:04 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:04.495896 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 145/291] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:04 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:04.769884 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-30a59292-d30c-474e-bc07-ca99e288e4c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:04.771318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-30a59292-d30c-474e-bc07-ca99e288e4c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:04.783876 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30a59292-d30c-474e-bc07-ca99e288e4c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.784884 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30a59292-d30c-474e-bc07-ca99e288e4c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.786038 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30a59292-d30c-474e-bc07-ca99e288e4c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.787070 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30a59292-d30c-474e-bc07-ca99e288e4c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.810088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-53660db6-9f61-4f8e-adcc-498b2c0ca274 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:04.812326 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-53660db6-9f61-4f8e-adcc-498b2c0ca274 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:04.830188 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-53660db6-9f61-4f8e-adcc-498b2c0ca274 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.830945 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-53660db6-9f61-4f8e-adcc-498b2c0ca274 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.834669 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-53660db6-9f61-4f8e-adcc-498b2c0ca274 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:04.837147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-53660db6-9f61-4f8e-adcc-498b2c0ca274 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:04.970022 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-30a59292-d30c-474e-bc07-ca99e288e4c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28276 microversion: 2.20 time: 0.207913 Nov 25 08:42:04.971239 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 147/292] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:04 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:04.990139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-53660db6-9f61-4f8e-adcc-498b2c0ca274 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28112 microversion: 2.1 time: 0.186005 Nov 25 08:42:04.990954 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 146/293] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:04 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28112 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:05.513289 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:05.514077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:05.520893 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:05.521484 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:05.522263 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:05.522700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:05.695001 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:05.703045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-be4cc79b-0f75-4b7f-a9eb-3ff5b6647698 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.194939 Nov 25 08:42:05.703897 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 148/294] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:05 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:05.737061 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-116244727", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-739661517", "security_groups": [{"name": "tempest-secgroup-smoke-497791862"}], "block_device_mapping_v2": [{"uuid": "50c0417f-0bf8-4c1f-b7fc-3d8b57c04cb9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b7242cf-308b-4aee-a391-1d7432608cad"}]}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:05.860453 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] validate_networks() for [('0b7242cf-308b-4aee-a391-1d7432608cad', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:42:05.908004 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-31667f39-a4a1-43b4-a57e-0c2619b8b937 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06b69a2d-df46-4a18-a9f5-389556c01141"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:05.909456 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-31667f39-a4a1-43b4-a57e-0c2619b8b937 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:05.918134 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31667f39-a4a1-43b4-a57e-0c2619b8b937 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:05.918688 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31667f39-a4a1-43b4-a57e-0c2619b8b937 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:05.920127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31667f39-a4a1-43b4-a57e-0c2619b8b937 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:05.920945 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-31667f39-a4a1-43b4-a57e-0c2619b8b937 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.231264 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-31667f39-a4a1-43b4-a57e-0c2619b8b937 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326975 Nov 25 08:42:06.233036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 149/295] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:42:05 2021] POST /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:42:06.239459 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-06910929-f5f8-40e0-bad7-222eb191523c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:06.242146 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-06910929-f5f8-40e0-bad7-222eb191523c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:06.252313 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-06910929-f5f8-40e0-bad7-222eb191523c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.253263 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-06910929-f5f8-40e0-bad7-222eb191523c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.254288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-06910929-f5f8-40e0-bad7-222eb191523c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.254934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-06910929-f5f8-40e0-bad7-222eb191523c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.413079 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-06910929-f5f8-40e0-bad7-222eb191523c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28439 microversion: 2.20 time: 0.172478 Nov 25 08:42:06.419421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 150/296] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:06 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28439 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:06.431306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-246039f8-a610-4d84-907f-56402cbf83ef tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:06.433380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-246039f8-a610-4d84-907f-56402cbf83ef tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:06.434227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:42:06.434868 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:42:06.436096 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:42:06.436874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:42:06.437500 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:42:06.441183 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-246039f8-a610-4d84-907f-56402cbf83ef tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.442454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-246039f8-a610-4d84-907f-56402cbf83ef tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.442553 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-246039f8-a610-4d84-907f-56402cbf83ef tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.443085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-246039f8-a610-4d84-907f-56402cbf83ef tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.452250 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.453076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.454845 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.456050 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.482883 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:42:06.488531 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for user 16a2f54eb10148c48a3cdd2641da5315 and project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:42:06.554052 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:42:06.556483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50c0417f-0bf8-4c1f-b7fc-3d8b57c04cb9',volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:42:06.567398 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-246039f8-a610-4d84-907f-56402cbf83ef tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28400 microversion: 2.1 time: 0.146232 Nov 25 08:42:06.568393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 151/297] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:06 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28400 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:06.573778 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-120050175", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:06.637239 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] validate_networks() for None {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:42:06.730494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b953c9c5-8a4f-4971-bfa8-dd4da515c1e0 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.996918 Nov 25 08:42:06.731408 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 147/298] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:42:05 2021] POST /compute/v2.1/servers => generated 405 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 25 08:42:06.746301 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:06.746921 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:06.754882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.755626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:06.758197 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:06.758649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:07.088879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:42:07.089671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:42:07.089671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:42:07.090072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:42:07.090675 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:42:07.114896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:07.114896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:07.115081 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:07.115503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:07.115503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:07.126607 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e78daa83-2e46-4f50-b178-c724909b078b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.385725 Nov 25 08:42:07.136074 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 148/299] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:06 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:07.141687 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b615a9c1-b8e3-4d61-b162-d1de15eeb7ff tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:07.142549 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b615a9c1-b8e3-4d61-b162-d1de15eeb7ff tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:07.173865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Getting quotas for project 172634b29f7c4eb9ab7523f6eb64569c. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:42:07.181076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Getting quotas for user aaaed6c4e25246128abcbc5c1a6446d4 and project 172634b29f7c4eb9ab7523f6eb64569c. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:42:07.198985 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:42:07.203339 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:42:07.255667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-034e7903-c016-4c57-882e-05a56519780d tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686038 Nov 25 08:42:07.256959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 152/300] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:42:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:42:07.285415 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bba9a7d7-0f61-4181-b741-e614f7a234e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:07.286983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bba9a7d7-0f61-4181-b741-e614f7a234e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:07.513750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b615a9c1-b8e3-4d61-b162-d1de15eeb7ff tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:07.521247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b615a9c1-b8e3-4d61-b162-d1de15eeb7ff tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1093 microversion: 2.1 time: 0.383620 Nov 25 08:42:07.521833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 149/301] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:07 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1093 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:07.535190 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-17c50f27-ad9d-4bc1-8095-84ae112221db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:07.538445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-17c50f27-ad9d-4bc1-8095-84ae112221db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:07.546513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-17c50f27-ad9d-4bc1-8095-84ae112221db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:07.552163 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-17c50f27-ad9d-4bc1-8095-84ae112221db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:07.553304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-17c50f27-ad9d-4bc1-8095-84ae112221db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:07.553560 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-bba9a7d7-0f61-4181-b741-e614f7a234e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:07.554230 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-17c50f27-ad9d-4bc1-8095-84ae112221db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:07.568590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bba9a7d7-0f61-4181-b741-e614f7a234e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1214 microversion: 2.1 time: 0.295179 Nov 25 08:42:07.569402 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 153/302] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:07 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1214 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:07.586387 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-09df247f-204a-4f89-8e85-84c1ebf4f59b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:07.592877 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-09df247f-204a-4f89-8e85-84c1ebf4f59b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:07.608272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09df247f-204a-4f89-8e85-84c1ebf4f59b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:07.609212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09df247f-204a-4f89-8e85-84c1ebf4f59b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:07.609883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09df247f-204a-4f89-8e85-84c1ebf4f59b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:07.610492 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09df247f-204a-4f89-8e85-84c1ebf4f59b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:07.668046 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-17c50f27-ad9d-4bc1-8095-84ae112221db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28605 microversion: 2.20 time: 0.141086 Nov 25 08:42:07.668724 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 150/303] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:07 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:07.997725 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-09df247f-204a-4f89-8e85-84c1ebf4f59b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28568 microversion: 2.1 time: 0.414845 Nov 25 08:42:08.000599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 154/304] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:07 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28568 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:08.143005 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:08.143940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:08.151368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.151848 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.152634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.153076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.291449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:08.300132 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d29b4085-b7d0-49d5-a52e-7ced62fbc110 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1521 microversion: 2.1 time: 0.161224 Nov 25 08:42:08.300769 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 151/305] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:08 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:08.544342 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:08.545093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:08.556186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.556899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.558009 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.558554 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.588306 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:08.589399 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:08.597568 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.598028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.598838 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.599279 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.659878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:08.670769 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-90bc4cbb-ecf7-45c8-bcdf-b12dd1100cc9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1199 microversion: 2.1 time: 0.134089 Nov 25 08:42:08.671671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 155/306] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:08 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1199 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:08.683913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-96205092-09b4-4442-97d8-b49455b42553 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:08.683913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-96205092-09b4-4442-97d8-b49455b42553 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:08.691503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-96205092-09b4-4442-97d8-b49455b42553 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.695338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:08.700175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-96205092-09b4-4442-97d8-b49455b42553 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.701064 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-96205092-09b4-4442-97d8-b49455b42553 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:08.701510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-96205092-09b4-4442-97d8-b49455b42553 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:08.709685 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-75458a9a-5bd9-49b2-8ae8-9e941bc42628 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1266 microversion: 2.1 time: 0.125717 Nov 25 08:42:08.710637 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 152/307] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:08 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:08.823107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-96205092-09b4-4442-97d8-b49455b42553 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28605 microversion: 2.20 time: 0.146035 Nov 25 08:42:08.823985 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 156/308] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:08 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28605 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:42:09.011030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2e518da8-e8d4-4074-8c2d-2828cbc5c350 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:09.012859 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2e518da8-e8d4-4074-8c2d-2828cbc5c350 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:09.021723 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2e518da8-e8d4-4074-8c2d-2828cbc5c350 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.022187 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2e518da8-e8d4-4074-8c2d-2828cbc5c350 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.023398 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2e518da8-e8d4-4074-8c2d-2828cbc5c350 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.023960 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2e518da8-e8d4-4074-8c2d-2828cbc5c350 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.153105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2e518da8-e8d4-4074-8c2d-2828cbc5c350 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28568 microversion: 2.1 time: 0.146930 Nov 25 08:42:09.154806 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 153/309] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:09 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:09.325727 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:09.326438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:09.342986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.344062 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.345609 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.346383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.706049 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:09.707396 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:09.721526 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.722812 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.724673 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.725820 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.742930 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:09.754684 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a40fbc11-5505-4f4d-a4e4-0502dbc5db83 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1501 microversion: 2.1 time: 0.435325 Nov 25 08:42:09.756267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 157/310] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:09 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1501 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:09.764035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:09.764651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:09.791787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.792612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.793650 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.794091 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.891939 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:09.907996 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e1ddb70b-e0c9-423a-9dcb-60a836c22c3c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1272 microversion: 2.1 time: 0.150145 Nov 25 08:42:09.909015 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 158/311] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:09 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:09.918294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:09.919800 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:09.930218 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.931396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:09.933119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:09.933920 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:10.256832 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:10.283585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b1273a0c-63a2-4936-b165-f64947faf577 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1276 microversion: 2.1 time: 0.588548 Nov 25 08:42:10.290424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 154/312] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:09 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1276 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:10.310822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-202940fc-6c51-467d-a168-53db81969d10 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:10.322695 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-202940fc-6c51-467d-a168-53db81969d10 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:10.351712 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-202940fc-6c51-467d-a168-53db81969d10 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:10.352569 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-202940fc-6c51-467d-a168-53db81969d10 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:10.354765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-202940fc-6c51-467d-a168-53db81969d10 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:10.359375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-202940fc-6c51-467d-a168-53db81969d10 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:10.511943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:10.532107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e5b856fd-a069-43ce-985f-e804afe1e18c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1517 microversion: 2.1 time: 0.620806 Nov 25 08:42:10.533529 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 159/313] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:09 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1517 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:10.545812 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-32bc7cdc-04e2-4d8e-881a-55ae6a494cf5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:10.548618 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-32bc7cdc-04e2-4d8e-881a-55ae6a494cf5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:10.551709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-202940fc-6c51-467d-a168-53db81969d10 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28605 microversion: 2.20 time: 0.257687 Nov 25 08:42:10.553386 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 155/314] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:10 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28605 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:10.573240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-32bc7cdc-04e2-4d8e-881a-55ae6a494cf5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:10.574465 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-32bc7cdc-04e2-4d8e-881a-55ae6a494cf5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:10.576216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-32bc7cdc-04e2-4d8e-881a-55ae6a494cf5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:10.577604 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-32bc7cdc-04e2-4d8e-881a-55ae6a494cf5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:10.739339 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-32bc7cdc-04e2-4d8e-881a-55ae6a494cf5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28568 microversion: 2.1 time: 0.203020 Nov 25 08:42:10.741084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 160/315] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:10 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:10.937173 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:10.938898 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:10.965650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:10.968501 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:10.972407 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:10.974951 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:11.321167 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:11.322451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:11.355320 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:11.356191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:11.357870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:11.358908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:11.751198 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:11.761030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-617c581f-a0f5-48c4-b895-06d6e011c8b2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.836557 Nov 25 08:42:11.762703 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 156/316] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:10 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:11.783338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d130e8dd-5cf6-4205-8d45-18fe233d7277 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:11.785780 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d130e8dd-5cf6-4205-8d45-18fe233d7277 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:11.799631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d130e8dd-5cf6-4205-8d45-18fe233d7277 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:11.800924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d130e8dd-5cf6-4205-8d45-18fe233d7277 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:11.803767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d130e8dd-5cf6-4205-8d45-18fe233d7277 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:11.804929 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d130e8dd-5cf6-4205-8d45-18fe233d7277 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:11.831282 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:11.860954 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e9e46df6-2aec-4ea9-acf1-091d5c19837a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1276 microversion: 2.1 time: 0.548435 Nov 25 08:42:11.866398 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 161/317] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:11 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1276 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:11.895327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d981f0bf-a6ba-411d-b937-5741f2383610 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:11.899545 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d981f0bf-a6ba-411d-b937-5741f2383610 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:11.913295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d981f0bf-a6ba-411d-b937-5741f2383610 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:11.914322 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d981f0bf-a6ba-411d-b937-5741f2383610 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:11.920322 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d981f0bf-a6ba-411d-b937-5741f2383610 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:11.922408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d981f0bf-a6ba-411d-b937-5741f2383610 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:11.985736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d130e8dd-5cf6-4205-8d45-18fe233d7277 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28605 microversion: 2.20 time: 0.205748 Nov 25 08:42:11.988739 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 157/318] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:11 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28605 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:12.011675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-59bc555e-8802-40f7-87ce-2be8e649769d req-9adf59fd-fab9-42f1-9fc1-d5c6c594ef0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b80c162-23ca-4be1-a17a-17ed4f5cd292", "tag": "3c92a0d9-11a1-4188-bd68-04327627b096"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:12.014752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:12.014752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:42:12.030238 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-59bc555e-8802-40f7-87ce-2be8e649769d req-9adf59fd-fab9-42f1-9fc1-d5c6c594ef0b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:12.031008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-59bc555e-8802-40f7-87ce-2be8e649769d req-9adf59fd-fab9-42f1-9fc1-d5c6c594ef0b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:12.058512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d981f0bf-a6ba-411d-b937-5741f2383610 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28568 microversion: 2.1 time: 0.188715 Nov 25 08:42:12.064948 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 162/319] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:11 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:12.092242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-3c90d470-995d-4ca8-a0b0-b6a982535f50 req-0204e55a-ce00-474c-9db6-33b6e43567a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee504ef-51bf-44f8-a9a2-222f68d2cd9b", "tag": "3eab4787-6ee8-4eb6-8d64-63594ea60f24"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:12.095242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:12.095242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:42:12.102742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-59bc555e-8802-40f7-87ce-2be8e649769d req-9adf59fd-fab9-42f1-9fc1-d5c6c594ef0b service nova] Creating event network-changed:3c92a0d9-11a1-4188-bd68-04327627b096 for instance 1b80c162-23ca-4be1-a17a-17ed4f5cd292 on hv-cinder-77819 Nov 25 08:42:12.115532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-59bc555e-8802-40f7-87ce-2be8e649769d req-9adf59fd-fab9-42f1-9fc1-d5c6c594ef0b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123180 Nov 25 08:42:12.116706 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 158/320] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:12.127688 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-3c90d470-995d-4ca8-a0b0-b6a982535f50 req-0204e55a-ce00-474c-9db6-33b6e43567a0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:12.129193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-3c90d470-995d-4ca8-a0b0-b6a982535f50 req-0204e55a-ce00-474c-9db6-33b6e43567a0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:12.172767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-3c90d470-995d-4ca8-a0b0-b6a982535f50 req-0204e55a-ce00-474c-9db6-33b6e43567a0 service nova] Creating event network-changed:3eab4787-6ee8-4eb6-8d64-63594ea60f24 for instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b on hv-cinder-77819 Nov 25 08:42:12.183381 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-3c90d470-995d-4ca8-a0b0-b6a982535f50 req-0204e55a-ce00-474c-9db6-33b6e43567a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119323 Nov 25 08:42:12.190107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 163/321] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:12.751453 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:12.756565 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:12.784209 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:12.785480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:12.788638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:12.795510 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:12.796835 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:12.797489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:12.806896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:12.808228 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:12.813223 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:12.814436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:12.867014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lazy-loading 'flavor' on Instance uuid a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:42:13.039103 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ddfb1c60-8f72-442f-9d77-8a532a164713 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action" status: 200 len: 32 microversion: 2.1 time: 0.322914 Nov 25 08:42:13.047771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 159/322] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:12 2021] POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:42:13.053663 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:13.054627 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:13.062384 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.063519 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.064512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.065099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.229310 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:13.244180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-879707c9-f2a4-46a1-947b-394e53295834 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.467173 Nov 25 08:42:13.245419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 164/323] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:12 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:13.250658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-af736022-6307-4884-b1a6-8c1199c77f7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:13.254230 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-af736022-6307-4884-b1a6-8c1199c77f7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:13.262125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af736022-6307-4884-b1a6-8c1199c77f7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.262896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af736022-6307-4884-b1a6-8c1199c77f7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.264019 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af736022-6307-4884-b1a6-8c1199c77f7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.264644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af736022-6307-4884-b1a6-8c1199c77f7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.381056 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-af736022-6307-4884-b1a6-8c1199c77f7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28605 microversion: 2.20 time: 0.133890 Nov 25 08:42:13.381742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 165/324] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:13 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28605 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:13.390461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:13.396339 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:13.417883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.418331 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.419130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.419701 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.607695 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:13.621194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-54ac4b5f-f208-41e1-9ad8-f6f88c5f4349 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1276 microversion: 2.1 time: 0.572059 Nov 25 08:42:13.622394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 160/325] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:13 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1276 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:13.627297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-95ce811f-13ec-42a3-8cff-e563cc5b0ea0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:13.628013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-95ce811f-13ec-42a3-8cff-e563cc5b0ea0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:13.651979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95ce811f-13ec-42a3-8cff-e563cc5b0ea0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.652402 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95ce811f-13ec-42a3-8cff-e563cc5b0ea0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.664333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95ce811f-13ec-42a3-8cff-e563cc5b0ea0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:13.665277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95ce811f-13ec-42a3-8cff-e563cc5b0ea0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:13.828815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-95ce811f-13ec-42a3-8cff-e563cc5b0ea0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28568 microversion: 2.1 time: 0.204849 Nov 25 08:42:13.831159 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 161/326] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:13 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:14.029112 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:14.043359 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a9e91aec-50f1-4145-ad81-c5c3aeddcc82 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.656474 Nov 25 08:42:14.044607 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 166/327] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:13 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:14.272888 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:14.273956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:14.283320 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.284048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:14.285836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.286841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:14.398305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0286413c-82d2-47fd-b16d-5867f1e5d56f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:14.399711 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0286413c-82d2-47fd-b16d-5867f1e5d56f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:14.407819 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0286413c-82d2-47fd-b16d-5867f1e5d56f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.408909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0286413c-82d2-47fd-b16d-5867f1e5d56f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:14.410006 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0286413c-82d2-47fd-b16d-5867f1e5d56f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.410870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0286413c-82d2-47fd-b16d-5867f1e5d56f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:14.513249 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0286413c-82d2-47fd-b16d-5867f1e5d56f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28605 microversion: 2.20 time: 0.118644 Nov 25 08:42:14.513919 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 167/328] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:14 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28605 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:42:14.550051 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06b69a2d-df46-4a18-a9f5-389556c01141"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:14.552207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:14.565711 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.566559 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:14.568109 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.568818 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:14.669104 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] HTTP exception thrown: Invalid volume: volume 06b69a2d-df46-4a18-a9f5-389556c01141 is already attached to instances: 6594bd69-10bc-4a9f-a5d8-9c110620ed10 Nov 25 08:42:14.669726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Returning 400 to user: Invalid volume: volume 06b69a2d-df46-4a18-a9f5-389556c01141 is already attached to instances: 6594bd69-10bc-4a9f-a5d8-9c110620ed10 {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:42:14.670575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d67ed32e-e138-4f7a-a197-2b2a859add3a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125057 Nov 25 08:42:14.671512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 168/329] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:42:14 2021] POST /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 25 08:42:14.676502 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:14.677893 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:14.686784 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.687267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:14.688104 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:14.688546 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.032020 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:15.045969 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9a76232f-2756-4ab1-9628-35e092390563 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.778594 Nov 25 08:42:15.047009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 162/330] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:14 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:15.056795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:15.057710 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:15.066213 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:15.070323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.071272 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.072636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.073244 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.081576 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a703ea59-a625-4cbd-a53e-05bffa428962 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.408466 Nov 25 08:42:15.082499 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 169/331] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:14 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:15.090436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7ac8152c-b166-4650-a7be-3dafc8a36e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:15.092005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7ac8152c-b166-4650-a7be-3dafc8a36e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:15.101575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ac8152c-b166-4650-a7be-3dafc8a36e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.102548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ac8152c-b166-4650-a7be-3dafc8a36e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.105945 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ac8152c-b166-4650-a7be-3dafc8a36e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.106821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ac8152c-b166-4650-a7be-3dafc8a36e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.205714 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7ac8152c-b166-4650-a7be-3dafc8a36e11 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28568 microversion: 2.1 time: 0.121819 Nov 25 08:42:15.210098 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 170/332] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:15 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28568 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:15.220462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:15.221174 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:15.229256 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.229808 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.230639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.231073 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.291438 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lazy-loading 'services' on Instance uuid 6594bd69-10bc-4a9f-a5d8-9c110620ed10 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:42:15.472724 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e58ae06d-214d-436d-b699-ab4a9e03610d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments/06b69a2d-df46-4a18-a9f5-389556c01141" status: 202 len: 0 microversion: 2.1 time: 0.423412 Nov 25 08:42:15.473401 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 163/333] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:42:15 2021] DELETE /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments/06b69a2d-df46-4a18-a9f5-389556c01141 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:15.485336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2dd186b9-9ac0-4bba-a3a7-0c073b43aade tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:15.486409 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2dd186b9-9ac0-4bba-a3a7-0c073b43aade tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:15.494457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2dd186b9-9ac0-4bba-a3a7-0c073b43aade tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.494661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2dd186b9-9ac0-4bba-a3a7-0c073b43aade tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.495439 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2dd186b9-9ac0-4bba-a3a7-0c073b43aade tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.496187 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2dd186b9-9ac0-4bba-a3a7-0c073b43aade tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.539030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2dd186b9-9ac0-4bba-a3a7-0c073b43aade tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058212 Nov 25 08:42:15.540521 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 164/334] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:42:15 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:15.546091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a7aaee97-4bae-43e4-8f14-353dbccfa3b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:15.547041 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a7aaee97-4bae-43e4-8f14-353dbccfa3b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:15.553767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7aaee97-4bae-43e4-8f14-353dbccfa3b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.556411 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7aaee97-4bae-43e4-8f14-353dbccfa3b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.556493 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:15.558165 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7aaee97-4bae-43e4-8f14-353dbccfa3b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:15.559672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a7aaee97-4bae-43e4-8f14-353dbccfa3b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:15.572753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2fbd0313-dd07-4e6d-b845-ac8e434e900e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.357973 Nov 25 08:42:15.574269 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 171/335] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:15 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:15.685577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a7aaee97-4bae-43e4-8f14-353dbccfa3b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 28637 microversion: 2.20 time: 0.143038 Nov 25 08:42:15.686262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 165/336] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:15 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 28637 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:16.063837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:16.064364 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:16.071332 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.073202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.074236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.075003 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.100579 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:16.101308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:16.109053 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.109488 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.110451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.111036 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.310247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:16.323723 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-41176536-fd18-4a64-a7d0-c0d8e149c2c6 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.262903 Nov 25 08:42:16.324967 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 172/337] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:16 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:16.334682 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:16.340679 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ed8e74f0-c322-4508-850a-63720efe1242 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:16.342217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ed8e74f0-c322-4508-850a-63720efe1242 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:16.345001 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3cdaa69c-5de9-409d-b54e-1024e6d257ef tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.248409 Nov 25 08:42:16.354966 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed8e74f0-c322-4508-850a-63720efe1242 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.355444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed8e74f0-c322-4508-850a-63720efe1242 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.355620 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 166/338] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:16 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:16.356559 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed8e74f0-c322-4508-850a-63720efe1242 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.361346 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed8e74f0-c322-4508-850a-63720efe1242 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.507097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ed8e74f0-c322-4508-850a-63720efe1242 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 28788 microversion: 2.1 time: 0.179269 Nov 25 08:42:16.508562 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 173/339] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:16 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 28788 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:16.560339 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5cbd0dd1-c555-4885-9c8d-a854e5041869 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:16.561912 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5cbd0dd1-c555-4885-9c8d-a854e5041869 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:16.575814 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5cbd0dd1-c555-4885-9c8d-a854e5041869 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.576966 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5cbd0dd1-c555-4885-9c8d-a854e5041869 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.579053 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5cbd0dd1-c555-4885-9c8d-a854e5041869 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.580203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5cbd0dd1-c555-4885-9c8d-a854e5041869 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.632159 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:16.635406 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:16.649227 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.651003 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.653625 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.655193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.687092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5cbd0dd1-c555-4885-9c8d-a854e5041869 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134504 Nov 25 08:42:16.688728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 167/340] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:42:16 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:16.701268 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b97d5261-c0e9-4b50-baa6-122d4eeeb659 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:16.702674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b97d5261-c0e9-4b50-baa6-122d4eeeb659 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:16.710315 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b97d5261-c0e9-4b50-baa6-122d4eeeb659 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.711115 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b97d5261-c0e9-4b50-baa6-122d4eeeb659 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.712790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b97d5261-c0e9-4b50-baa6-122d4eeeb659 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:16.713622 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b97d5261-c0e9-4b50-baa6-122d4eeeb659 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:16.824117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b97d5261-c0e9-4b50-baa6-122d4eeeb659 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 29271 microversion: 2.20 time: 0.127728 Nov 25 08:42:16.825099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 168/341] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:16 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 29271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:16.857353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:16.867832 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b718e07b-6c73-483c-89a5-eefce9cd3f68 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.264738 Nov 25 08:42:16.879034 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 174/342] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:16 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:17.343162 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:17.344041 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:17.352290 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.352789 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.353823 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.354372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.365314 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:17.366605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:17.376710 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.377463 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.378852 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.379853 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.619225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:17.631261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cd0ee446-f302-4742-9d4a-9d8fbd79c9e1 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.292448 Nov 25 08:42:17.632904 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 169/343] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:17 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:17.641018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:17.641603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3ead5120-d54a-462a-9c9d-612ac20fcc10 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:17.643262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3ead5120-d54a-462a-9c9d-612ac20fcc10 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:17.653515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ead5120-d54a-462a-9c9d-612ac20fcc10 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.655835 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ead5120-d54a-462a-9c9d-612ac20fcc10 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.657376 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ead5120-d54a-462a-9c9d-612ac20fcc10 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.658101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ead5120-d54a-462a-9c9d-612ac20fcc10 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.658832 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4ac0ca5f-4e3e-42e9-a633-7a01a4feb314 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.297634 Nov 25 08:42:17.669763 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 175/344] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:17 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:17.702241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a73e8687-fa40-42de-b314-b8237fa08e08 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:17.703272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a73e8687-fa40-42de-b314-b8237fa08e08 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:17.710390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a73e8687-fa40-42de-b314-b8237fa08e08 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.710824 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a73e8687-fa40-42de-b314-b8237fa08e08 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.711695 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a73e8687-fa40-42de-b314-b8237fa08e08 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.712197 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a73e8687-fa40-42de-b314-b8237fa08e08 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.771227 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a73e8687-fa40-42de-b314-b8237fa08e08 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073916 Nov 25 08:42:17.772590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 176/345] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:42:17 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 25 08:42:17.774038 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3ead5120-d54a-462a-9c9d-612ac20fcc10 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 29752 microversion: 2.1 time: 0.139151 Nov 25 08:42:17.776869 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 170/346] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:17 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 29752 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:17.855693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-65150c21-2507-4702-a2dc-cf61d0ec3573 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:17.856453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-65150c21-2507-4702-a2dc-cf61d0ec3573 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:17.870538 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-65150c21-2507-4702-a2dc-cf61d0ec3573 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.871306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-65150c21-2507-4702-a2dc-cf61d0ec3573 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.873128 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-65150c21-2507-4702-a2dc-cf61d0ec3573 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.873574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-65150c21-2507-4702-a2dc-cf61d0ec3573 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.888402 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:17.888952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:17.899196 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.900525 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:17.901755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:17.902368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.018021 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-65150c21-2507-4702-a2dc-cf61d0ec3573 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 30187 microversion: 2.20 time: 0.175584 Nov 25 08:42:18.018479 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 177/347] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:17 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 30187 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:18.053495 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-688106939", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "0ddee4b4-d930-497a-91bb-d464076fa1b3"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:18.098526 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:18.108581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a17dd0af-9d19-4a8b-a3ea-0a5ff99ec96e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.226784 Nov 25 08:42:18.109272 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 171/348] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:17 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:18.138525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] validate_networks() for [('0ddee4b4-d930-497a-91bb-d464076fa1b3', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:42:18.655935 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:18.657254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:18.671112 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.672207 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.673863 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.674781 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.699202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:42:18.700328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:42:18.701863 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:42:18.702972 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:42:18.707674 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:42:18.722328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.722958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.723917 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.724399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.747908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:42:18.753450 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Getting quotas for user c150bf72536c4fc3bb247e9cbb9e1b45 and project 3412713b28e44d47abca28c866ca338e. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:42:18.770255 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:42:18.774530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:42:18.871283 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e46d6e37-830d-4de1-a7fd-eb3fe6bd567f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822473 Nov 25 08:42:18.872507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 178/349] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:42:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:42:18.887733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:18.889489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:18.900563 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.901153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.911660 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.912629 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.938363 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:18.947868 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f9cf08db-c0dc-4643-b3d8-75364ee030e8 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.300102 Nov 25 08:42:18.949220 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 172/350] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:18 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:18.954322 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-92bcb977-2899-44ac-9a9f-c023a15edb20 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:18.955539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-92bcb977-2899-44ac-9a9f-c023a15edb20 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:18.970215 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92bcb977-2899-44ac-9a9f-c023a15edb20 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.971836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92bcb977-2899-44ac-9a9f-c023a15edb20 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:18.977746 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92bcb977-2899-44ac-9a9f-c023a15edb20 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:18.978544 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92bcb977-2899-44ac-9a9f-c023a15edb20 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:19.119745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-92bcb977-2899-44ac-9a9f-c023a15edb20 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 30887 microversion: 2.1 time: 0.167959 Nov 25 08:42:19.121649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 173/351] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:18 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 30887 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:19.132530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:19.132876 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f440ed7f-6460-4267-8c75-2a3ab10b6931 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:19.135147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f440ed7f-6460-4267-8c75-2a3ab10b6931 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:19.142761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7a9fdc78-44ac-442d-bd0a-9aa86db3b538 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.264386 Nov 25 08:42:19.143430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 179/352] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:18 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:19.157315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a49959e6-5244-49d6-bd6c-40a6a172afda tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:19.158408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a49959e6-5244-49d6-bd6c-40a6a172afda tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:19.168001 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a49959e6-5244-49d6-bd6c-40a6a172afda tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:19.168644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a49959e6-5244-49d6-bd6c-40a6a172afda tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:19.169530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a49959e6-5244-49d6-bd6c-40a6a172afda tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:19.170067 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a49959e6-5244-49d6-bd6c-40a6a172afda tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:19.224228 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f440ed7f-6460-4267-8c75-2a3ab10b6931 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:19.232584 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f440ed7f-6460-4267-8c75-2a3ab10b6931 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1217 microversion: 2.1 time: 0.108206 Nov 25 08:42:19.233178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 174/353] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:19 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:19.241617 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:19.242379 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:19.250187 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:19.250639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:19.251440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:19.251909 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:19.266385 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a49959e6-5244-49d6-bd6c-40a6a172afda tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 31484 microversion: 2.20 time: 0.112354 Nov 25 08:42:19.276480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 180/354] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:19 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 31484 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:19.461256 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:19.477152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6d968608-26f8-4f0e-88bc-0f13ac0c2ff4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.239731 Nov 25 08:42:19.478285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 175/355] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:19 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:19.980299 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:19.981183 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:19.989451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:19.989905 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:19.990792 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:19.991422 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:19.998921 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-0d71c497-b337-4dde-93dd-698967096c8f req-30011a1a-da7f-4e26-8422-6ad0aab7797b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b80c162-23ca-4be1-a17a-17ed4f5cd292", "name": "network-vif-plugged", "status": "completed", "tag": "3c92a0d9-11a1-4188-bd68-04327627b096"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:20.002333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:20.002333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:42:20.015269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-0d71c497-b337-4dde-93dd-698967096c8f req-30011a1a-da7f-4e26-8422-6ad0aab7797b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.016351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-0d71c497-b337-4dde-93dd-698967096c8f req-30011a1a-da7f-4e26-8422-6ad0aab7797b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.033421 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-0d71c497-b337-4dde-93dd-698967096c8f req-30011a1a-da7f-4e26-8422-6ad0aab7797b service nova] Creating event network-vif-plugged:3c92a0d9-11a1-4188-bd68-04327627b096 for instance 1b80c162-23ca-4be1-a17a-17ed4f5cd292 on hv-cinder-77819 Nov 25 08:42:20.042287 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-0d71c497-b337-4dde-93dd-698967096c8f req-30011a1a-da7f-4e26-8422-6ad0aab7797b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049296 Nov 25 08:42:20.043457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 176/356] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:42:20.137644 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a596ecad-5bb8-46ba-9c27-f0e810482ff8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:20.138837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a596ecad-5bb8-46ba-9c27-f0e810482ff8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:20.155358 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a596ecad-5bb8-46ba-9c27-f0e810482ff8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.156169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a596ecad-5bb8-46ba-9c27-f0e810482ff8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.157635 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a596ecad-5bb8-46ba-9c27-f0e810482ff8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.158807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a596ecad-5bb8-46ba-9c27-f0e810482ff8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.215422 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:20.239098 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-12c85cb2-6a05-490f-8564-977be726a523 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.267262 Nov 25 08:42:20.240596 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 181/357] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:19 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:20.263240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:20.264080 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:20.274352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.276155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.276890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.278059 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.330051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a596ecad-5bb8-46ba-9c27-f0e810482ff8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 31860 microversion: 2.1 time: 0.199835 Nov 25 08:42:20.331496 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 177/358] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:20 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 31860 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:20.343370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:20.344884 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:20.358072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.358863 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.360337 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.361141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.476441 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:20.491893 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-34333520-e774-4972-8b53-e33c47a51f98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1269 microversion: 2.1 time: 0.157463 Nov 25 08:42:20.493170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 178/359] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:20 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:20.511350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-30b5ccc1-7229-4064-a0da-fd43b812da91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:20.512404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-30b5ccc1-7229-4064-a0da-fd43b812da91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:20.528398 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30b5ccc1-7229-4064-a0da-fd43b812da91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.529360 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30b5ccc1-7229-4064-a0da-fd43b812da91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.530924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30b5ccc1-7229-4064-a0da-fd43b812da91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.531848 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30b5ccc1-7229-4064-a0da-fd43b812da91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.664044 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-30b5ccc1-7229-4064-a0da-fd43b812da91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 32536 microversion: 2.20 time: 0.167242 Nov 25 08:42:20.666558 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 179/360] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:20 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 32536 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:20.678126 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:20.680299 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:20.694855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.697677 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.699749 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:20.700778 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:20.767356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:20.783322 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-88104143-c097-4cd9-84c5-9a3a9cb009a7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.526129 Nov 25 08:42:20.784094 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 182/361] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:20 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:20.973723 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:20.983502 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3c82d29c-942e-4f03-bd33-eb0fedfb42f2 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.313880 Nov 25 08:42:20.994960 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 180/362] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:20 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:21.268858 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:21.269667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:21.280037 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.280696 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:21.282203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.282798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:21.353899 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-21160189-e041-4847-ac44-4f029952f8f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:21.356507 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-21160189-e041-4847-ac44-4f029952f8f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:21.371719 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21160189-e041-4847-ac44-4f029952f8f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.372545 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21160189-e041-4847-ac44-4f029952f8f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:21.373854 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21160189-e041-4847-ac44-4f029952f8f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.374578 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21160189-e041-4847-ac44-4f029952f8f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:21.578860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:21.592236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3cbf5562-6372-4513-919a-1e28449d2672 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.327133 Nov 25 08:42:21.601713 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 183/363] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:21 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:21.615485 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:21.615942 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:21.624169 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.624809 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:21.625900 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.626395 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:21.715371 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:21.727464 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-29b31e28-8e49-4052-bba7-4a58b5d97f38 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1275 microversion: 2.1 time: 0.122983 Nov 25 08:42:21.728896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 184/364] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:21 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:21.738267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-437c5543-c635-405e-b527-58bc2e4e5844 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:21.739190 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-437c5543-c635-405e-b527-58bc2e4e5844 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:21.749328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-437c5543-c635-405e-b527-58bc2e4e5844 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.749947 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-437c5543-c635-405e-b527-58bc2e4e5844 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:21.751067 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-437c5543-c635-405e-b527-58bc2e4e5844 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:21.751668 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-437c5543-c635-405e-b527-58bc2e4e5844 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:24.728493 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-21160189-e041-4847-ac44-4f029952f8f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 33117 microversion: 2.1 time: 3.386331 Nov 25 08:42:24.732722 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 181/365] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:21 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 33117 bytes in 3390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:24.737141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:24.737858 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:24.745847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:24.746291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:24.747087 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:24.747521 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:24.858708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-437c5543-c635-405e-b527-58bc2e4e5844 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 34507 microversion: 2.20 time: 3.128086 Nov 25 08:42:24.865381 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 185/366] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:21 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 34507 bytes in 3132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:24.869690 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:24.870836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:24.880750 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:24.881513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:24.882641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:24.883394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.093947 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:25.109993 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-42ef21d7-94ac-45fa-be51-c60cf3575a00 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.376951 Nov 25 08:42:25.111196 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 182/367] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:24 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:25.135915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:25.136774 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:25.145491 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.146147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.148160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.165576 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.320934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:25.335210 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a1aa6f29-a9c9-4881-9287-98c96ff74937 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.472096 Nov 25 08:42:25.336220 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 186/368] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:24 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:25.341989 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:25.342518 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:25.349709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.350318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.351149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.351855 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.552097 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:25.566309 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7e9c4ae4-db54-4c43-a935-33cc9c8bc967 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1314 microversion: 2.1 time: 0.452845 Nov 25 08:42:25.568064 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 183/369] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:25 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:25.739240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:25.746695 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2627f2c6-5c35-4a98-b19c-bbf5d24dfc34 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:25.747859 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2627f2c6-5c35-4a98-b19c-bbf5d24dfc34 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:25.751114 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1ada612a-69e2-4156-86be-0072941b70be tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.412942 Nov 25 08:42:25.753928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 187/370] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:25 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:25.755855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2627f2c6-5c35-4a98-b19c-bbf5d24dfc34 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.756644 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2627f2c6-5c35-4a98-b19c-bbf5d24dfc34 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.757769 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2627f2c6-5c35-4a98-b19c-bbf5d24dfc34 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.758304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2627f2c6-5c35-4a98-b19c-bbf5d24dfc34 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.879402 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d45478e2-f392-4377-a29a-27b4c39855ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:25.881459 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d45478e2-f392-4377-a29a-27b4c39855ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:25.894607 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2627f2c6-5c35-4a98-b19c-bbf5d24dfc34 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 34142 microversion: 2.1 time: 0.152189 Nov 25 08:42:25.896765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 184/371] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:25 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 34142 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:25.910016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d45478e2-f392-4377-a29a-27b4c39855ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.910880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d45478e2-f392-4377-a29a-27b4c39855ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.912374 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d45478e2-f392-4377-a29a-27b4c39855ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.913180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d45478e2-f392-4377-a29a-27b4c39855ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:25.982277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-12939313-9848-41d4-ac88-534a2e880758 req-da44f450-4e56-445a-8995-5eaea25b70ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0", "tag": "0934d921-242f-4af1-b9f6-e9d52009e97f"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:25.984493 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:25.984493 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:42:25.996133 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-12939313-9848-41d4-ac88-534a2e880758 req-da44f450-4e56-445a-8995-5eaea25b70ad service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:25.996661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-12939313-9848-41d4-ac88-534a2e880758 req-da44f450-4e56-445a-8995-5eaea25b70ad service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.010344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-12939313-9848-41d4-ac88-534a2e880758 req-da44f450-4e56-445a-8995-5eaea25b70ad service nova] Creating event network-changed:0934d921-242f-4af1-b9f6-e9d52009e97f for instance 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 on hv-cinder-77819 Nov 25 08:42:26.015685 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-12939313-9848-41d4-ac88-534a2e880758 req-da44f450-4e56-445a-8995-5eaea25b70ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037230 Nov 25 08:42:26.016274 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 185/372] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:42:26.061607 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d45478e2-f392-4377-a29a-27b4c39855ed tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 34922 microversion: 2.20 time: 0.190831 Nov 25 08:42:26.063287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 188/373] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:25 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 34922 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:42:26.145015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:26.148875 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:26.161876 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.162703 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.164346 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.165681 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.362132 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:26.362915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:26.371157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.371637 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.372468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.372908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.798368 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:26.808819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:26.810715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-30206a3c-387e-43de-8919-868f8d0db719 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.453290 Nov 25 08:42:26.811605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 189/374] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:26 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:26.816731 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:26.817758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:26.826824 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-808b8ddb-f7b5-4d8a-9fbc-0e8ddf8f6d90 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.690114 Nov 25 08:42:26.827917 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 186/375] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:26 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:26.834222 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.835024 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.836841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.837963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.842548 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:26.843161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:26.853892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.855471 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:26.857339 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:26.858139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.226289 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:27.241715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-66a99fbd-41b3-405d-96ca-8d2f0b6acfb2 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1463 microversion: 2.1 time: 0.428229 Nov 25 08:42:27.244364 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 190/376] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:26 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:27.253170 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d4e65bd2-96bc-4ec1-ba07-e89a21aaafeb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:27.255086 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d4e65bd2-96bc-4ec1-ba07-e89a21aaafeb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:27.268311 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4e65bd2-96bc-4ec1-ba07-e89a21aaafeb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.269402 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4e65bd2-96bc-4ec1-ba07-e89a21aaafeb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.270839 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4e65bd2-96bc-4ec1-ba07-e89a21aaafeb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.271892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4e65bd2-96bc-4ec1-ba07-e89a21aaafeb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.299510 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:27.323509 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ede04b9c-aca2-47f1-823a-06f69fbdcd43 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.493671 Nov 25 08:42:27.328568 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 187/377] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:26 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:27.335368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9c16318d-f1b6-4f12-b165-aa7aa8052943 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:27.337810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9c16318d-f1b6-4f12-b165-aa7aa8052943 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:27.345417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c16318d-f1b6-4f12-b165-aa7aa8052943 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.345901 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c16318d-f1b6-4f12-b165-aa7aa8052943 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.346734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c16318d-f1b6-4f12-b165-aa7aa8052943 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.347213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c16318d-f1b6-4f12-b165-aa7aa8052943 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.443472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d4e65bd2-96bc-4ec1-ba07-e89a21aaafeb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 34800 microversion: 2.1 time: 0.196243 Nov 25 08:42:27.447200 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 191/378] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:27 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 34800 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:27.455876 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:27.456458 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:27.464493 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.464943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.465960 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.466383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.471368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9c16318d-f1b6-4f12-b165-aa7aa8052943 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 35504 microversion: 2.20 time: 0.140526 Nov 25 08:42:27.486491 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 188/379] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:27 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 35504 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:27.500343 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Going to try to terminate instance {{(pid=122643) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:42:27.606569 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4c422c6a-a52d-4e13-990b-1671a60400d9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 204 len: 0 microversion: 2.1 time: 0.155293 Nov 25 08:42:27.610353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 192/380] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:42:27 2021] DELETE /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:42:27.620798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:27.621523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:27.629291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.630054 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.630913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.631656 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.846575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:27.848642 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:27.860681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.861423 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:27.862788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:27.863817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.004895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:28.013395 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7193b45a-ad5c-4057-9dca-06886632acdc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1469 microversion: 2.1 time: 0.398068 Nov 25 08:42:28.013984 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 189/381] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:27 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1469 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:28.018750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:28.019363 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:28.027309 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.028084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.029158 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.029882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.166467 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:28.176947 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c01a6aa1-2d77-4c7e-8380-1f973898bf20 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.337824 Nov 25 08:42:28.178113 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 193/382] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:27 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:28.243937 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:28.252297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c86a91f4-aadd-46ff-8359-5d87ad6658de tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.236924 Nov 25 08:42:28.252790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 190/383] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:28 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:28.351423 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:28.352291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:28.360288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.360888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.362179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.362816 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.466734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-40df27e1-d311-483e-bec7-b1b785d9b81f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:28.468600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-40df27e1-d311-483e-bec7-b1b785d9b81f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:28.484360 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40df27e1-d311-483e-bec7-b1b785d9b81f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.485692 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40df27e1-d311-483e-bec7-b1b785d9b81f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.487229 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40df27e1-d311-483e-bec7-b1b785d9b81f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.488055 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40df27e1-d311-483e-bec7-b1b785d9b81f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.638079 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-40df27e1-d311-483e-bec7-b1b785d9b81f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 35211 microversion: 2.1 time: 0.179009 Nov 25 08:42:28.639332 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 191/384] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:28 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 35211 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:28.650307 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0a688e59-a2d7-4c79-95b5-9764f9b1382b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:28.652259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0a688e59-a2d7-4c79-95b5-9764f9b1382b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:28.665207 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0a688e59-a2d7-4c79-95b5-9764f9b1382b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.666263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0a688e59-a2d7-4c79-95b5-9764f9b1382b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.667697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0a688e59-a2d7-4c79-95b5-9764f9b1382b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:28.668489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0a688e59-a2d7-4c79-95b5-9764f9b1382b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:28.701421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:28.721610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-25eac709-7449-4c53-9498-94f93f66de98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.374117 Nov 25 08:42:28.722763 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 194/385] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:28 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:28.833708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0a688e59-a2d7-4c79-95b5-9764f9b1382b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 35856 microversion: 2.20 time: 0.191615 Nov 25 08:42:28.835043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 192/386] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:28 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 35856 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:29.046153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:29.047335 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:29.059269 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.060541 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.062120 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.063129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.200472 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:29.202642 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:29.213547 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.214332 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.215798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.216773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.311409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:29.326329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3220073b-767b-45b3-b693-7a24058263ca tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1469 microversion: 2.1 time: 0.287316 Nov 25 08:42:29.327309 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 195/387] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:29 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:29.335819 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:29.337688 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:29.348480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.349291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.350729 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.351492 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.515596 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:29.532602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9e7817d2-a419-4b67-adf8-766eed3eabca tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.338305 Nov 25 08:42:29.534054 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 193/388] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:29 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:29.593838 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:29.610018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0272c985-b3ad-40cc-89ee-b28346c417e9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.280208 Nov 25 08:42:29.611399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 196/389] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:29 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:29.657693 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-00a5a7aa-be8d-4525-b223-5bbda4a98a48 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:29.659384 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-00a5a7aa-be8d-4525-b223-5bbda4a98a48 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:29.669987 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00a5a7aa-be8d-4525-b223-5bbda4a98a48 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.670856 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00a5a7aa-be8d-4525-b223-5bbda4a98a48 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.672078 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00a5a7aa-be8d-4525-b223-5bbda4a98a48 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.672656 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00a5a7aa-be8d-4525-b223-5bbda4a98a48 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.745195 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:29.746270 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:29.754508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.755183 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.756548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.757262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.814555 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-00a5a7aa-be8d-4525-b223-5bbda4a98a48 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 35609 microversion: 2.1 time: 0.163130 Nov 25 08:42:29.815812 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 194/390] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:29 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 35609 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:29.850123 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7635bf7b-1c08-487b-af97-ec577b02f29c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:29.851329 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7635bf7b-1c08-487b-af97-ec577b02f29c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:29.871630 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7635bf7b-1c08-487b-af97-ec577b02f29c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.872972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7635bf7b-1c08-487b-af97-ec577b02f29c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.875798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7635bf7b-1c08-487b-af97-ec577b02f29c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:29.880533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7635bf7b-1c08-487b-af97-ec577b02f29c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:29.982139 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:29.999850 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-50f2aee5-223b-4900-bbec-fa8c29f33449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.260598 Nov 25 08:42:30.001002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 197/391] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:29 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:30.027741 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7635bf7b-1c08-487b-af97-ec577b02f29c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 36466 microversion: 2.20 time: 0.181570 Nov 25 08:42:30.029339 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 195/392] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:29 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 36466 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:42:30.350665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:30.352050 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:30.363601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:30.364409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:30.365813 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:30.366665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:30.568389 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:30.571822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:30.588151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:30.589406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:30.591040 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:30.593947 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:30.733099 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:30.748193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-41c87969-d1b9-4c8e-b5c2-e2b608e911a9 tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1469 microversion: 2.1 time: 0.405146 Nov 25 08:42:30.749665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 198/393] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:30 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1469 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:30.759020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:30.760885 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:30.783307 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:30.788199 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:30.789548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:30.791646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.136204 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:31.162429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1dbd2342-433a-4254-bea8-caf8ba4e3851 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.602873 Nov 25 08:42:31.163505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 196/394] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:30 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:31.178852 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d04578ba-e392-4a5b-9592-95ff92f160f9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:31.184915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d04578ba-e392-4a5b-9592-95ff92f160f9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:31.195407 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d04578ba-e392-4a5b-9592-95ff92f160f9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.209059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d04578ba-e392-4a5b-9592-95ff92f160f9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.210255 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d04578ba-e392-4a5b-9592-95ff92f160f9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.210882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d04578ba-e392-4a5b-9592-95ff92f160f9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.300899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:31.311023 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e35d29d0-30a8-459a-9e9e-1791d6b9b6b4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.559405 Nov 25 08:42:31.322878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 199/395] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:30 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:31.324419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:31.324856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:31.333687 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.334195 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.335036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.335473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.343672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d04578ba-e392-4a5b-9592-95ff92f160f9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 36639 microversion: 2.1 time: 0.177541 Nov 25 08:42:31.350638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 197/396] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:31 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 36639 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:31.356160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9b9ebbfb-496b-4c4f-be56-7940af9cdcf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:31.357095 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9b9ebbfb-496b-4c4f-be56-7940af9cdcf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:31.371074 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9b9ebbfb-496b-4c4f-be56-7940af9cdcf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.372431 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9b9ebbfb-496b-4c4f-be56-7940af9cdcf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.373983 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9b9ebbfb-496b-4c4f-be56-7940af9cdcf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.374770 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9b9ebbfb-496b-4c4f-be56-7940af9cdcf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.546064 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9b9ebbfb-496b-4c4f-be56-7940af9cdcf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 37554 microversion: 2.20 time: 0.198401 Nov 25 08:42:31.547260 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 198/397] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:31 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 37554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:31.556285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-8454c78d-db9a-4440-9adc-9de78d31f63b req-ef52c0e7-9985-4f56-99bd-f25b57805a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b80c162-23ca-4be1-a17a-17ed4f5cd292", "name": "network-vif-deleted", "tag": "3c92a0d9-11a1-4188-bd68-04327627b096"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:31.558979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:31.558979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:42:31.582027 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-8454c78d-db9a-4440-9adc-9de78d31f63b req-ef52c0e7-9985-4f56-99bd-f25b57805a98 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.583537 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-8454c78d-db9a-4440-9adc-9de78d31f63b req-ef52c0e7-9985-4f56-99bd-f25b57805a98 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.613013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-8454c78d-db9a-4440-9adc-9de78d31f63b req-ef52c0e7-9985-4f56-99bd-f25b57805a98 service nova] Creating event network-vif-deleted:3c92a0d9-11a1-4188-bd68-04327627b096 for instance 1b80c162-23ca-4be1-a17a-17ed4f5cd292 on hv-cinder-77819 Nov 25 08:42:31.614084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:31.622136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-8454c78d-db9a-4440-9adc-9de78d31f63b req-ef52c0e7-9985-4f56-99bd-f25b57805a98 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073319 Nov 25 08:42:31.626156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5ad8afb4-758b-4443-ba45-e8e0ae8503ec tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.306875 Nov 25 08:42:31.626849 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 199/398] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:31.636807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-fc774b84-d4ec-44d3-9f57-c7d8eb1c25b9 req-b7c00c01-74fb-4fe8-be66-f94066f42af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee504ef-51bf-44f8-a9a2-222f68d2cd9b", "name": "network-vif-plugged", "status": "completed", "tag": "3eab4787-6ee8-4eb6-8d64-63594ea60f24"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:31.637389 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 200/399] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:31 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:31.638620 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:31.638620 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:42:31.647281 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-fc774b84-d4ec-44d3-9f57-c7d8eb1c25b9 req-b7c00c01-74fb-4fe8-be66-f94066f42af2 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.648073 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-fc774b84-d4ec-44d3-9f57-c7d8eb1c25b9 req-b7c00c01-74fb-4fe8-be66-f94066f42af2 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.661895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-fc774b84-d4ec-44d3-9f57-c7d8eb1c25b9 req-b7c00c01-74fb-4fe8-be66-f94066f42af2 service nova] Creating event network-vif-plugged:3eab4787-6ee8-4eb6-8d64-63594ea60f24 for instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b on hv-cinder-77819 Nov 25 08:42:31.667660 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-fc774b84-d4ec-44d3-9f57-c7d8eb1c25b9 req-b7c00c01-74fb-4fe8-be66-f94066f42af2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038853 Nov 25 08:42:31.668638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 200/400] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:31.777436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:31.778726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:31.791979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.792596 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.793778 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.794311 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.832907 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:31.833415 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:31.833916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lazy-loading 'fault' on Instance uuid 1b80c162-23ca-4be1-a17a-17ed4f5cd292 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:42:31.881295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaaed6c4e25246128abcbc5c1a6446d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172634b29f7c4eb9ab7523f6eb64569c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:31.891651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5ae6ea96-6e93-45c1-b4de-395cbf000d0c tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 200 len: 1304 microversion: 2.1 time: 0.120075 Nov 25 08:42:31.892475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 201/401] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:31 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:32.201538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:32.203734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:32.216631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.217975 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.219494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.220361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.346493 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:32.348642 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:32.362813 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.364225 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.366009 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.367133 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.484784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:32.496415 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c9c8589e-8e4a-4575-a538-de0777a95a45 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.303751 Nov 25 08:42:32.497318 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 201/402] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:32 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:32.513709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-dab13561-9dd9-48ad-8f43-97f06e3ac33c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:32.514977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-dab13561-9dd9-48ad-8f43-97f06e3ac33c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:32.535108 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dab13561-9dd9-48ad-8f43-97f06e3ac33c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.535979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dab13561-9dd9-48ad-8f43-97f06e3ac33c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.538409 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dab13561-9dd9-48ad-8f43-97f06e3ac33c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.541537 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dab13561-9dd9-48ad-8f43-97f06e3ac33c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.599160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:32.614222 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d5c5981b-ea76-4f09-a42c-0a6ff253671d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.274143 Nov 25 08:42:32.615428 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 202/403] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:32 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:32.621060 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-223b1fd6-4c32-402f-a8bc-664fd2c47565 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:32.622697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-223b1fd6-4c32-402f-a8bc-664fd2c47565 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:32.631613 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-223b1fd6-4c32-402f-a8bc-664fd2c47565 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.632461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-223b1fd6-4c32-402f-a8bc-664fd2c47565 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.633577 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-223b1fd6-4c32-402f-a8bc-664fd2c47565 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.634275 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-223b1fd6-4c32-402f-a8bc-664fd2c47565 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.661641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-dab13561-9dd9-48ad-8f43-97f06e3ac33c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 37458 microversion: 2.1 time: 0.162073 Nov 25 08:42:32.662804 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 202/404] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:32 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 37458 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:32.675639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:32.677377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:32.689979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.690591 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.691798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.692289 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.747381 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-223b1fd6-4c32-402f-a8bc-664fd2c47565 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 38120 microversion: 2.20 time: 0.130380 Nov 25 08:42:32.748205 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 203/405] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:32 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 38120 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:32.875405 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:32.886179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-27fa8283-008a-478c-ac2c-32a40463b4fb tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.220838 Nov 25 08:42:32.886961 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 203/406] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:32 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:32.911927 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:32.913047 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] [instance: 1b80c162-23ca-4be1-a17a-17ed4f5cd292] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:32.924119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.924807 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.925811 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:32.926321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:32.949504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] HTTP exception thrown: Instance 1b80c162-23ca-4be1-a17a-17ed4f5cd292 could not be found. Nov 25 08:42:32.950109 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] Returning 404 to user: Instance 1b80c162-23ca-4be1-a17a-17ed4f5cd292 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:42:32.950958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-61e55688-5647-4835-a3f8-06dc5c8367cc tempest-VolumesNegativeTest-46493136 tempest-VolumesNegativeTest-46493136-project] 10.222.0.46 "GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292" status: 404 len: 111 microversion: 2.1 time: 0.044149 Nov 25 08:42:32.951550 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 204/407] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:32 2021] GET /compute/v2.1/servers/1b80c162-23ca-4be1-a17a-17ed4f5cd292 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:42:33.522294 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:33.523528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:33.536529 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:33.540321 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:33.540321 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:33.540321 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:33.643598 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:33.644471 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:33.654992 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:33.655713 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:33.657350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:33.658059 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:33.884297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:33.893291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e76ac9aa-8975-461f-8f11-a26e0e167f04 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.377501 Nov 25 08:42:33.897176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 204/408] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:33 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:33.903990 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2be53f56-333f-4cd5-8f42-5f8fc82dedf0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:33.905099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2be53f56-333f-4cd5-8f42-5f8fc82dedf0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:33.912132 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be53f56-333f-4cd5-8f42-5f8fc82dedf0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:33.912680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be53f56-333f-4cd5-8f42-5f8fc82dedf0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:33.913733 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be53f56-333f-4cd5-8f42-5f8fc82dedf0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:33.914411 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be53f56-333f-4cd5-8f42-5f8fc82dedf0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.017805 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2be53f56-333f-4cd5-8f42-5f8fc82dedf0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 37992 microversion: 2.1 time: 0.118595 Nov 25 08:42:34.018815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 205/409] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:33 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 37992 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:42:34.027686 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-404d3542-4ba1-419f-9186-d4224de13124 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:34.030198 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-404d3542-4ba1-419f-9186-d4224de13124 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:34.051186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-404d3542-4ba1-419f-9186-d4224de13124 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.051746 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-404d3542-4ba1-419f-9186-d4224de13124 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.052592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-404d3542-4ba1-419f-9186-d4224de13124 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.053039 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-404d3542-4ba1-419f-9186-d4224de13124 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.068733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:34.131934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9bc2baa1-071f-40f3-b336-6c658e2baed3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1264 microversion: 2.1 time: 0.493190 Nov 25 08:42:34.134071 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 205/410] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:33 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1264 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:34.146205 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:34.147296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:34.159922 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.160750 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.162218 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.163241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.190484 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-404d3542-4ba1-419f-9186-d4224de13124 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 200 len: 38263 microversion: 2.20 time: 0.169501 Nov 25 08:42:34.192024 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 206/411] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:34 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 38263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:34.209728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-62f19668-19cf-427f-9b28-0e836b7d362c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:34.210612 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-62f19668-19cf-427f-9b28-0e836b7d362c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:34.221092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f19668-19cf-427f-9b28-0e836b7d362c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.221900 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f19668-19cf-427f-9b28-0e836b7d362c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.223300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f19668-19cf-427f-9b28-0e836b7d362c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.223930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f19668-19cf-427f-9b28-0e836b7d362c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.268086 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-62f19668-19cf-427f-9b28-0e836b7d362c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/ips" status: 200 len: 153 microversion: 2.20 time: 0.065682 Nov 25 08:42:34.271737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 207/412] 10.222.0.46 () {60 vars in 1288 bytes} [Thu Nov 25 08:42:34 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/ips => generated 153 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:34.409786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:34.419516 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b74aea33-9451-4be0-b65b-1e5188c6bc0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.282956 Nov 25 08:42:34.431234 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 206/413] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:34 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:34.939939 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:34.942059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:34.955242 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.956352 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:34.958024 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:34.959122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.037823 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b9dea225-4411-416f-86b9-036467a1dc36 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:35.044386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b9dea225-4411-416f-86b9-036467a1dc36 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:35.057580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9dea225-4411-416f-86b9-036467a1dc36 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.058982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9dea225-4411-416f-86b9-036467a1dc36 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.061153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9dea225-4411-416f-86b9-036467a1dc36 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.062554 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9dea225-4411-416f-86b9-036467a1dc36 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.189439 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:35.208141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-18b5368e-c841-44f1-b60b-780b4b2b4894 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.278827 Nov 25 08:42:35.209660 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 208/414] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:34 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:35.211695 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b9dea225-4411-416f-86b9-036467a1dc36 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 200 len: 38142 microversion: 2.1 time: 0.179397 Nov 25 08:42:35.216821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-896b359f-2430-4216-b3e4-f84745810957 req-a3da5e8f-77e8-4756-ba19-772683f0f969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0", "name": "network-vif-plugged", "status": "completed", "tag": "0934d921-242f-4af1-b9f6-e9d52009e97f"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:35.223207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 207/415] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:35 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 38142 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:42:35.236513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:35.237825 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:35.243482 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:35.243482 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:42:35.255467 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.256880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.259326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.260436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.269567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-896b359f-2430-4216-b3e4-f84745810957 req-a3da5e8f-77e8-4756-ba19-772683f0f969 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.270543 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-896b359f-2430-4216-b3e4-f84745810957 req-a3da5e8f-77e8-4756-ba19-772683f0f969 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.308383 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-896b359f-2430-4216-b3e4-f84745810957 req-a3da5e8f-77e8-4756-ba19-772683f0f969 service nova] Creating event network-vif-plugged:0934d921-242f-4af1-b9f6-e9d52009e97f for instance 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 on hv-cinder-77819 Nov 25 08:42:35.316146 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-896b359f-2430-4216-b3e4-f84745810957 req-a3da5e8f-77e8-4756-ba19-772683f0f969 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104229 Nov 25 08:42:35.319985 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 209/416] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:35.326758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c3fc03ba-fcf3-4255-966a-96cf7610de93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:35.330580 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c3fc03ba-fcf3-4255-966a-96cf7610de93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:35.351430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c3fc03ba-fcf3-4255-966a-96cf7610de93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.352084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c3fc03ba-fcf3-4255-966a-96cf7610de93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.353507 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c3fc03ba-fcf3-4255-966a-96cf7610de93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.354039 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c3fc03ba-fcf3-4255-966a-96cf7610de93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.404249 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c3fc03ba-fcf3-4255-966a-96cf7610de93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/ips" status: 200 len: 145 microversion: 2.1 time: 0.082222 Nov 25 08:42:35.404836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 210/417] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Nov 25 08:42:35 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/ips => generated 145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:35.447597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:35.448785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:35.457794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.458694 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.461061 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.462712 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.746037 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:35.768559 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e4a9fabc-f1d4-46fb-8807-0d7e54ab20cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1450 microversion: 2.1 time: 0.542932 Nov 25 08:42:35.770194 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 208/418] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:35 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1450 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:35.795796 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:35.804055 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:35.808159 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:35.834489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.838396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.838856 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8e07b480-8254-4c8c-965e-90d743df5073 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.385622 Nov 25 08:42:35.839998 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:35.841170 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:35.854567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 211/419] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:35 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:36.227639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:36.228730 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:36.244581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:36.245330 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:36.246728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:36.247480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:36.419750 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:36.433944 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d176b77e-74a7-4298-a3b7-85b82bb10ed7 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1450 microversion: 2.1 time: 0.637908 Nov 25 08:42:36.434983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 209/420] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:35 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1450 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:36.501142 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:36.517340 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5f3e5c07-25ac-4b1a-8a09-f557e002839e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.294152 Nov 25 08:42:36.519032 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 212/421] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:36 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:36.883950 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:36.885055 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:36.895002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:36.896085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:36.897475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:36.898294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:37.172831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:37.188662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4426e0c9-da00-4dd8-9381-2815b10dbf69 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.309390 Nov 25 08:42:37.190048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 210/422] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:36 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:37.545156 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:37.547921 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:37.556319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:37.556793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:37.557619 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:37.558256 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:37.756868 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:37.766445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6bfea5d3-d5b5-4ba7-8d90-afffa726941a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.227104 Nov 25 08:42:37.767214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 213/423] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:37 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:38.215524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:38.217079 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:38.225706 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:38.226286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:38.227851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:38.228588 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:38.406575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:38.415000 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-132bbb1b-878d-48cd-943a-15a38594ff98 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.203889 Nov 25 08:42:38.415886 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 211/424] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:38 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:38.788724 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:38.789964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:38.798738 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:38.799442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:38.800867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:38.801524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:38.997851 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:39.006225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c71336c4-3dbb-4300-9f9e-99a17618e321 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.221479 Nov 25 08:42:39.006911 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 214/425] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:38 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:39.014117 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:39.014959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:39.022195 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:39.022654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:39.023510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:39.025299 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:39.053350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lazy-loading 'flavor' on Instance uuid 861e5c47-a03f-44f8-8181-954812e9b38b {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:42:39.375746 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-ad161ff7-2978-402e-bec6-c6445fdef210 req-d1a4786a-d506-4160-9044-42fada32e458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee504ef-51bf-44f8-a9a2-222f68d2cd9b", "tag": "3eab4787-6ee8-4eb6-8d64-63594ea60f24"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:39.377333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:39.377333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:42:39.387226 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-ad161ff7-2978-402e-bec6-c6445fdef210 req-d1a4786a-d506-4160-9044-42fada32e458 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:39.388030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-ad161ff7-2978-402e-bec6-c6445fdef210 req-d1a4786a-d506-4160-9044-42fada32e458 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:39.403432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-ad161ff7-2978-402e-bec6-c6445fdef210 req-d1a4786a-d506-4160-9044-42fada32e458 service nova] Creating event network-changed:3eab4787-6ee8-4eb6-8d64-63594ea60f24 for instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b on hv-cinder-77819 Nov 25 08:42:39.410205 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-ad161ff7-2978-402e-bec6-c6445fdef210 req-d1a4786a-d506-4160-9044-42fada32e458 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038385 Nov 25 08:42:39.413512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 215/426] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:39.448374 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:39.451880 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:39.470026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:39.473070 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:39.475616 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:39.477844 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:39.527370 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d026e491-e96e-4bec-908f-dbb1a6a89c87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 202 len: 0 microversion: 2.20 time: 0.518997 Nov 25 08:42:39.532334 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 212/427] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:42:39 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 25 08:42:39.548153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:39.553831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:39.565184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:39.565955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:39.567097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:39.567608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:40.156838 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:40.183789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:40.184013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:40.188778 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:40.192301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-837b5969-c722-46fe-b515-01df04a2c2b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.653573 Nov 25 08:42:40.192413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e1806f4c-13ab-48cf-8f62-fabcfe8e9ba3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1317 microversion: 2.1 time: 0.759456 Nov 25 08:42:40.202885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 216/428] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:39 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1317 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:40.202885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:40.202885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:40.207203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 213/429] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:39 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:40.221339 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:40.223828 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:40.224762 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:40.225219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:40.544483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:40.564302 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9a3c1ea7-0986-424d-9b06-efab16eca08c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.367910 Nov 25 08:42:40.565113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 217/430] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:40 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:40.980827 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bad93f36-685b-4b12-bff3-436a8fd8b07c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eceeb480-8d83-4383-bf5d-0e570ff7208d"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:40.981934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bad93f36-685b-4b12-bff3-436a8fd8b07c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:40.989341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bad93f36-685b-4b12-bff3-436a8fd8b07c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:40.989802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bad93f36-685b-4b12-bff3-436a8fd8b07c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:40.990633 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bad93f36-685b-4b12-bff3-436a8fd8b07c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:40.991146 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bad93f36-685b-4b12-bff3-436a8fd8b07c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:41.213476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:41.215359 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:41.224314 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:41.225259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:41.226467 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:41.227521 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:41.578224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bad93f36-685b-4b12-bff3-436a8fd8b07c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601849 Nov 25 08:42:41.599400 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:41.600114 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 214/431] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:42:40 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-volume_attachments => generated 194 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:41.606681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:41.610167 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-688aabcd-ddf7-4fa1-b5c2-bb9f6739190e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1507 microversion: 2.1 time: 0.403480 Nov 25 08:42:41.612254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 218/432] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:41 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:42:41.620915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:41.625225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:41.627333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:41.643523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:41.644461 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:41.645908 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:41.646684 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:41.658654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:41.665160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:41.667377 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:41.672543 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:42.019097 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:42.036054 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-22c96266-aaa4-4421-b27f-c5c57a945eaa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.421203 Nov 25 08:42:42.037867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 219/433] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:41 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:42.047054 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:42.058557 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:42.060154 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:42.061364 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f190e879-a8e2-4652-8931-3eb0d420161e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.467468 Nov 25 08:42:42.062210 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 215/434] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:41 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:43.059072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:43.060332 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:43.074636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.075498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.077060 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.078847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.089439 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:43.090735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:43.106602 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.107954 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.109563 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.110470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.368844 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:43.383895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a556905e-c4fc-4446-81b7-980ac518021b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1503 microversion: 2.1 time: 0.331366 Nov 25 08:42:43.385355 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 220/435] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:43 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:43.405548 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74275fb7-bd21-41bd-993d-1eefea0e15f5"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:43.406704 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:43.415263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.416950 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.418088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.418754 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.420329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:43.437644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:43.441201 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:43.443634 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-66dbf67f-cade-4c99-b754-2a20375196aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.363655 Nov 25 08:42:43.444652 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 216/436] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:43 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:42:43.454208 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] HTTP exception thrown: Cannot 'attach_volume' instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 while it is in vm_state rescued Nov 25 08:42:43.455093 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Returning 409 to user: Cannot 'attach_volume' instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 while it is in vm_state rescued {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:42:43.456451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-70b6d485-fb3b-4306-a975-fdd1e482ca23 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055251 Nov 25 08:42:43.457052 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 221/437] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:42:43 2021] POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 25 08:42:43.472054 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-109ad214-88e7-4c50-be7f-084004b2a608 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:43.472995 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-109ad214-88e7-4c50-be7f-084004b2a608 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:43.484219 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-109ad214-88e7-4c50-be7f-084004b2a608 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.485316 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-109ad214-88e7-4c50-be7f-084004b2a608 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.486788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-109ad214-88e7-4c50-be7f-084004b2a608 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.487581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-109ad214-88e7-4c50-be7f-084004b2a608 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.646399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-109ad214-88e7-4c50-be7f-084004b2a608 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action" status: 202 len: 0 microversion: 2.1 time: 0.180691 Nov 25 08:42:43.651881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 217/438] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:43 2021] POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:43.659312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:43.660460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:43.679235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5940b9f1-412e-46a2-864a-a60aa9f1f515 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d9e694f-80b4-4ed7-bcb0-5f1f8787ff5a"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:43.681292 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5940b9f1-412e-46a2-864a-a60aa9f1f515 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:43.684738 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.685827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.687122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.688237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.696755 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5940b9f1-412e-46a2-864a-a60aa9f1f515 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.697212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5940b9f1-412e-46a2-864a-a60aa9f1f515 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.698060 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5940b9f1-412e-46a2-864a-a60aa9f1f515 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:43.699940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5940b9f1-412e-46a2-864a-a60aa9f1f515 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:43.965072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:43.983214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b881e1db-0fda-4f3c-add4-f3550e303ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1511 microversion: 2.1 time: 0.328031 Nov 25 08:42:43.983827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 222/439] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:43 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:44.468045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:44.469432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:44.482051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:44.482655 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:44.484085 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:44.484859 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:44.698080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:44.707610 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:44.709816 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:44.711630 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2980fb58-989e-4679-87e5-ead4de7e99bf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.250288 Nov 25 08:42:44.713055 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 223/440] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:44 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:45.006888 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:45.009179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:45.022827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:45.038141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:45.040833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:45.041638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:45.246821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:45.259156 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6928caaa-0a4f-41d2-a601-c70daa84966a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1511 microversion: 2.1 time: 0.258247 Nov 25 08:42:45.262997 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 224/441] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:44 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:45.747535 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:45.749807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:45.761910 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:45.763018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:45.765217 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:45.766280 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:46.000352 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:46.010286 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:46.012202 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:46.013631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2098ca8d-6b26-4552-80a0-396e28c5a4aa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.274102 Nov 25 08:42:46.014808 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 225/442] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:45 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:42:46.282270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:46.283522 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:46.299310 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:46.304678 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:46.306669 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:46.307980 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:46.673784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:46.706389 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-aa075f73-8806-4355-93f5-bd5c5ffa13f6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1511 microversion: 2.1 time: 0.430588 Nov 25 08:42:46.709392 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 226/443] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:46 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:46.739091 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5940b9f1-412e-46a2-864a-a60aa9f1f515 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "POST /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.065922 Nov 25 08:42:46.741352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 218/444] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:42:43 2021] POST /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 194 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:42:47.033348 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:47.034766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:47.050836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:47.051327 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:47.055203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:47.055821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:47.527081 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:47.545655 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:47.553327 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:47.559128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9491b407-2125-444d-8d99-d75569eb39e2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.528453 Nov 25 08:42:47.560755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 227/445] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:47 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:47.739516 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:47.741271 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:47.751227 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:47.751982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:47.752998 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:47.753616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:48.061427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:48.084905 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-987c5f44-ceeb-4d56-95cc-998b57735434 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1511 microversion: 2.1 time: 0.348406 Nov 25 08:42:48.100470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 219/446] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:47 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:48.590726 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:48.591390 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:48.600858 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:48.603708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:48.604969 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:48.608148 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:48.940910 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:48.960101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:48.963284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:48.965890 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0f0599bf-8fa4-4a6e-b1c5-88e0534c4ca8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.379630 Nov 25 08:42:48.967654 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 228/447] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:48 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:49.125009 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:49.126107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:49.143801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:49.144527 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:49.145821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:49.146525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:49.636266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:49.696880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-41f1c4d6-7621-4fe8-b3fa-368819649ae5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1511 microversion: 2.1 time: 0.579867 Nov 25 08:42:49.704156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 220/448] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:49 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:50.012572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:50.016936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:50.031293 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:50.032440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:50.034269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:50.035027 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:50.447312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:50.459615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:50.462508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:50.465767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-124ea284-2fec-4b01-896f-2b5a16d1c9de tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.462201 Nov 25 08:42:50.467537 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 229/449] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:50 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:42:50.730923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:50.731870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:50.755858 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:50.757842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:50.759118 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:50.765118 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:51.022233 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:51.031290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ecf62155-b734-4c26-8091-93d17d979cd4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1517 microversion: 2.1 time: 0.304952 Nov 25 08:42:51.031909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 221/450] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:50 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:51.033943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-768807f3-abe9-4f1c-bb1e-18b2f8c9629c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:51.046702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-768807f3-abe9-4f1c-bb1e-18b2f8c9629c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:51.047868 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-768807f3-abe9-4f1c-bb1e-18b2f8c9629c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:51.188561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-768807f3-abe9-4f1c-bb1e-18b2f8c9629c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Going to try to stop instance {{(pid=122641) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 25 08:42:51.278940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-768807f3-abe9-4f1c-bb1e-18b2f8c9629c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 202 len: 0 microversion: 2.1 time: 0.253003 Nov 25 08:42:51.284677 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 230/451] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:42:51 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:42:51.291765 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:51.292568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:51.307753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:51.308420 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:51.309514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:51.309970 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:51.495302 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:51.496767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:51.504105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:51.504819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:51.506829 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:51.508059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:51.603990 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:51.624792 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9db92cb4-b692-4445-b3da-622bb032043d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.338278 Nov 25 08:42:51.626841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 222/452] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:51 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:51.895456 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:51.915029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:51.918414 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:51.920694 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-434fe746-9753-4094-b199-a547d8e84e8e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.430030 Nov 25 08:42:51.921980 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 231/453] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:51 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:42:52.644515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:52.646439 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:52.653368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:52.654571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:52.659703 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:52.660865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:52.662670 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:52.663755 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:52.673516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:52.676267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:52.679986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:52.681287 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:53.060868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:53.073158 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-21f4dba1-7d85-4e82-a5b7-5861a7efa9ee tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1517 microversion: 2.1 time: 0.434266 Nov 25 08:42:53.073968 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 223/454] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:52 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1517 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:53.081723 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:53.090626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:53.092132 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:53.102517 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-89915bd4-6f3e-4d35-8708-15f38a50c87e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.459291 Nov 25 08:42:53.102888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:53.103735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:53.104724 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:53.104884 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 232/455] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:52 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:53.106292 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:53.116709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1f6bd980-16a2-4e51-b0b2-38d6f899ebe8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cddaa442-e9cc-4c20-8e69-67585f335673"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:53.118569 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1f6bd980-16a2-4e51-b0b2-38d6f899ebe8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:53.133127 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f6bd980-16a2-4e51-b0b2-38d6f899ebe8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:53.133594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f6bd980-16a2-4e51-b0b2-38d6f899ebe8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:53.134621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f6bd980-16a2-4e51-b0b2-38d6f899ebe8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:53.135228 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f6bd980-16a2-4e51-b0b2-38d6f899ebe8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:53.632396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:53.653128 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:53.659270 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:53.662762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3c22bfda-aa1b-47ef-82a4-48518afef709 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.576933 Nov 25 08:42:53.664871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 224/456] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:53 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:53.722802 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1f6bd980-16a2-4e51-b0b2-38d6f899ebe8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615047 Nov 25 08:42:53.736443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 233/457] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:42:53 2021] POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:54.128155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:54.129299 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:54.141364 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:54.142224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:54.143837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:54.144900 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:54.699159 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:54.699990 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:54.709700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:54.712319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:54.713685 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:54.714397 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:54.865400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:54.900717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d9d74fdb-8659-4d35-9004-16df4aeaee78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.780274 Nov 25 08:42:54.924684 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 225/458] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:54 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:55.284024 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:55.304014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:55.309664 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:55.317803 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-69baeb5c-f21a-4535-a45f-583db79ba77a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.621801 Nov 25 08:42:55.320580 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 234/459] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:54 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:55.954241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:55.962338 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:55.996042 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:55.997433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:55.999074 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:55.999770 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:56.339986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:56.340764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:56.357514 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:56.361210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:56.362432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:56.365405 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:56.436574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:56.459398 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f7a00ace-dd50-41c0-a7fc-ebcef3d92cb9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.530483 Nov 25 08:42:56.480166 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 226/460] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:55 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:56.667434 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:56.682224 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:56.686546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:56.691173 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8c6f3558-e856-4c5f-bcb1-d78ccb3d04c9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1747 microversion: 2.20 time: 0.356152 Nov 25 08:42:56.696467 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 235/461] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:56 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1747 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:57.506871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:57.511912 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:57.536471 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:57.544620 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:57.547108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:57.548370 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:57.744608 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:57.752312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:57.771915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:57.773685 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:57.775658 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:57.777106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:58.088718 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:58.112660 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-55c48b00-ca08-4b07-babd-57a402a00886 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.628428 Nov 25 08:42:58.115760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 227/462] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:57 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:58.149153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:58.149657 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:58.165817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:58.167375 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:58.169352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:58.170586 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:58.261477 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:58.275544 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:58.282305 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:58.283776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-03c4726e-ef3e-4aee-877f-9e81af7d1df1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1747 microversion: 2.20 time: 0.547376 Nov 25 08:42:58.305989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 236/463] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:57 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1747 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:42:58.373488 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lazy-loading 'services' on Instance uuid 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:42:58.554079 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f5f7accb-783e-41f4-aed2-61090efc16cc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments/3d9e694f-80b4-4ed7-bcb0-5f1f8787ff5a" status: 202 len: 0 microversion: 2.1 time: 0.408485 Nov 25 08:42:58.555513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 228/464] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:42:58 2021] DELETE /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments/3d9e694f-80b4-4ed7-bcb0-5f1f8787ff5a => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:42:58.566477 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-bf367901-a273-4a04-87ac-b33c86bd714a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:58.567876 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-bf367901-a273-4a04-87ac-b33c86bd714a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:58.584511 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf367901-a273-4a04-87ac-b33c86bd714a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:58.587807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf367901-a273-4a04-87ac-b33c86bd714a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:58.589840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf367901-a273-4a04-87ac-b33c86bd714a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:58.590297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bf367901-a273-4a04-87ac-b33c86bd714a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:58.746336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-bf367901-a273-4a04-87ac-b33c86bd714a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182626 Nov 25 08:42:58.756184 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 237/465] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:42:58 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:59.144994 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:59.148393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:59.189025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:59.191452 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:59.193534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:59.195608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:59.316239 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:59.317039 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:59.341777 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:59.345902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:59.349286 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:59.353051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:59.645369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:59.689438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-812fe31c-b7b1-4e29-a594-944e1144a4b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.556334 Nov 25 08:42:59.691861 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 229/466] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:42:59 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:42:59.707431 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-f4d645f1-ac56-4bf4-97b5-717b843be539 req-929d63d8-c0df-4d82-bbce-a59e94d9363d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e5c47-a03f-44f8-8181-954812e9b38b", "name": "network-vif-plugged", "status": "completed", "tag": "e813642c-c46b-4870-94db-1582911a9fad"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:42:59.719613 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:42:59.719613 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:42:59.749781 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-f4d645f1-ac56-4bf4-97b5-717b843be539 req-929d63d8-c0df-4d82-bbce-a59e94d9363d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:59.755168 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-f4d645f1-ac56-4bf4-97b5-717b843be539 req-929d63d8-c0df-4d82-bbce-a59e94d9363d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:59.812085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-f4d645f1-ac56-4bf4-97b5-717b843be539 req-929d63d8-c0df-4d82-bbce-a59e94d9363d service nova] Creating event network-vif-plugged:e813642c-c46b-4870-94db-1582911a9fad for instance 861e5c47-a03f-44f8-8181-954812e9b38b on hv-cinder-77819 Nov 25 08:42:59.837562 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-f4d645f1-ac56-4bf4-97b5-717b843be539 req-929d63d8-c0df-4d82-bbce-a59e94d9363d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142442 Nov 25 08:42:59.845277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:59.858922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:59.860554 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 230/467] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:42:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:42:59.861039 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:42:59.862569 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-840040a2-2814-408c-b45e-eabebc9b1317 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.557582 Nov 25 08:42:59.863717 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 238/468] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:42:59 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:42:59.893581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f40b95e0-ef57-45aa-8cd8-dbc1b70c0fcc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:42:59.900013 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f40b95e0-ef57-45aa-8cd8-dbc1b70c0fcc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:42:59.925165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f40b95e0-ef57-45aa-8cd8-dbc1b70c0fcc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:59.925622 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f40b95e0-ef57-45aa-8cd8-dbc1b70c0fcc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:59.926667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f40b95e0-ef57-45aa-8cd8-dbc1b70c0fcc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:42:59.927286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f40b95e0-ef57-45aa-8cd8-dbc1b70c0fcc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:42:59.970420 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f40b95e0-ef57-45aa-8cd8-dbc1b70c0fcc tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094615 Nov 25 08:42:59.971340 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 231/469] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:42:59 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:00.725354 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:00.727494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:00.740001 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:00.741261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:00.743978 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:00.745201 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:00.894348 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:00.895595 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:00.905169 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:00.906129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:00.907513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:00.908220 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:01.015223 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:01.031194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-541abc57-bcdd-4470-bc97-df0e7a66eab0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.312014 Nov 25 08:43:01.041936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 239/470] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:00 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:01.053193 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-db87328a-3434-4563-8ffe-0a951d8ba5b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:01.054756 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-db87328a-3434-4563-8ffe-0a951d8ba5b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:01.063969 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db87328a-3434-4563-8ffe-0a951d8ba5b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:01.064481 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db87328a-3434-4563-8ffe-0a951d8ba5b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:01.065124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db87328a-3434-4563-8ffe-0a951d8ba5b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:01.065568 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db87328a-3434-4563-8ffe-0a951d8ba5b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:01.187581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-db87328a-3434-4563-8ffe-0a951d8ba5b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144142 Nov 25 08:43:01.188497 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 240/471] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:43:01 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:01.263978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:01.273396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:01.281249 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:01.283474 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ddaa2be8-bc83-48c5-a34e-615946b9b7ea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.396797 Nov 25 08:43:01.284383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 232/472] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:00 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:02.056119 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:02.060810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:02.087740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:02.097098 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:02.102360 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:02.107078 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:02.206845 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6e6e7714-bd48-4d1c-ae04-a609b3257e79 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:02.209490 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6e6e7714-bd48-4d1c-ae04-a609b3257e79 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:02.245904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e6e7714-bd48-4d1c-ae04-a609b3257e79 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:02.248323 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e6e7714-bd48-4d1c-ae04-a609b3257e79 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:02.249380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e6e7714-bd48-4d1c-ae04-a609b3257e79 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:02.254121 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e6e7714-bd48-4d1c-ae04-a609b3257e79 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:02.331712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6e6e7714-bd48-4d1c-ae04-a609b3257e79 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132487 Nov 25 08:43:02.338136 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 233/473] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:43:02 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:02.343378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:02.344017 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:02.352749 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:02.353624 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:02.355404 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:02.356277 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:02.485188 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:02.504501 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d29b10dc-a19f-4a4d-a6c1-306d65de8742 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.456879 Nov 25 08:43:02.506745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 241/474] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:02 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:02.582069 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:02.593696 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:02.595699 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:02.597386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-da2bd1a7-114b-44d2-81bf-3fa042369f59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.258140 Nov 25 08:43:02.598686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 234/475] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:02 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:03.350459 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-50ef9ed0-04c0-490a-b431-55fbda14b079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:03.352035 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-50ef9ed0-04c0-490a-b431-55fbda14b079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:03.366067 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50ef9ed0-04c0-490a-b431-55fbda14b079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:03.366670 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50ef9ed0-04c0-490a-b431-55fbda14b079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:03.367765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50ef9ed0-04c0-490a-b431-55fbda14b079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:03.368366 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50ef9ed0-04c0-490a-b431-55fbda14b079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:03.405940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-50ef9ed0-04c0-490a-b431-55fbda14b079 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059660 Nov 25 08:43:03.406973 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 242/476] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:43:03 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:03.544470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:03.550471 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:03.586006 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:03.586798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:03.588542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:03.589804 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:03.624019 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:03.624797 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:03.639264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:03.639821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:03.640696 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:03.641158 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:03.894323 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:03.907709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e0506ac5-3ede-40c7-9b98-390066051b71 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.380876 Nov 25 08:43:03.911542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 235/477] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:03 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:04.024365 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:04.045733 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:04.057639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:04.061237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-75874fe6-b613-4aea-9345-ba940aa61d25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.445265 Nov 25 08:43:04.062676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 243/478] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:03 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:04.433488 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ae6fad8b-6dbd-44a7-8898-0d5cf90128a2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:04.442868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ae6fad8b-6dbd-44a7-8898-0d5cf90128a2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:04.466815 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae6fad8b-6dbd-44a7-8898-0d5cf90128a2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:04.479847 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae6fad8b-6dbd-44a7-8898-0d5cf90128a2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:04.479847 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae6fad8b-6dbd-44a7-8898-0d5cf90128a2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:04.479847 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae6fad8b-6dbd-44a7-8898-0d5cf90128a2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:04.621688 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ae6fad8b-6dbd-44a7-8898-0d5cf90128a2 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202733 Nov 25 08:43:04.629022 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 236/479] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:43:04 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:04.695049 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:04.697251 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:04.714145 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:04.714849 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:04.716560 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:04.717353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:04.799070 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lazy-loading 'flavor' on Instance uuid a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:43:04.940588 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:04.941626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:04.973438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:04.974156 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:04.976419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:04.977617 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:05.094989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-08bda87d-cc64-429e-9ff7-79a61fb924a1 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action" status: 200 len: 32 microversion: 2.1 time: 0.408894 Nov 25 08:43:05.096445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 244/480] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:43:04 2021] POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action => generated 32 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:43:05.105749 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:05.108091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:05.128439 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:05.129295 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:05.130369 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:05.131133 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:05.647238 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:05.682182 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:05.685699 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:05.697285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0c8a5837-b31b-420d-b645-376c6e0282cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.598465 Nov 25 08:43:05.702883 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 245/481] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:05 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:05.747764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:05.749266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:05.800126 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:05.814560 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fd99dbdc-482f-48ad-bfd0-a1a89f22ec88 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.876887 Nov 25 08:43:05.816018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 237/482] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:04 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:05.825734 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2b3f5316-31df-4a15-adb9-c2adbd4142a9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:05.826730 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:05.828331 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:05.829316 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2b3f5316-31df-4a15-adb9-c2adbd4142a9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:05.844010 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b3f5316-31df-4a15-adb9-c2adbd4142a9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:05.845768 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:05.847492 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b3f5316-31df-4a15-adb9-c2adbd4142a9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:05.848159 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:05.849875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b3f5316-31df-4a15-adb9-c2adbd4142a9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:05.852182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b3f5316-31df-4a15-adb9-c2adbd4142a9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:05.926791 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2b3f5316-31df-4a15-adb9-c2adbd4142a9 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109195 Nov 25 08:43:05.936666 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 238/483] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:43:05 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:06.319020 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:06.347984 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5f5fc9a8-8b3a-4246-a8ac-3c310470b850 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.639359 Nov 25 08:43:06.349031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 246/484] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:05 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:06.743438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:06.744776 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:06.755469 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:06.756398 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:06.760753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:06.760753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:06.847465 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:06.848127 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:06.865500 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:06.867185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:06.868230 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:06.868678 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:07.074232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:07.083844 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:07.090497 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:07.093508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-85d8f17d-ee62-44ff-910c-c71c93f2d583 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.356502 Nov 25 08:43:07.104378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 239/485] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:06 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:07.113313 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-38a05d39-8efe-4cf1-a21a-5f0feea4ee46 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:07.114727 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-38a05d39-8efe-4cf1-a21a-5f0feea4ee46 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:07.128408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38a05d39-8efe-4cf1-a21a-5f0feea4ee46 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:07.133508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38a05d39-8efe-4cf1-a21a-5f0feea4ee46 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:07.136312 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38a05d39-8efe-4cf1-a21a-5f0feea4ee46 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:07.140341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38a05d39-8efe-4cf1-a21a-5f0feea4ee46 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:07.155366 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:07.165040 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d19eb77d-1782-4321-ae0a-9ee0e78fcfc7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.321527 Nov 25 08:43:07.166268 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 247/486] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:06 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:07.190460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-38a05d39-8efe-4cf1-a21a-5f0feea4ee46 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081934 Nov 25 08:43:07.197425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 240/487] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:43:07 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:43:07.371846 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:07.374883 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:07.390090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:07.391430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:07.393059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:07.393913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:07.676372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:07.686579 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a1979d83-e9a0-4360-bcc8-4fd2a3641830 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.323170 Nov 25 08:43:07.687371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 248/488] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:07 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:08.122208 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:08.126396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:08.157958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.158650 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.159809 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.160319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.196319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:08.197680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:08.207382 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.208338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.212474 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.213296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.575917 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:08.581161 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:08.586663 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-48f7b1a0-f843-4886-8f73-494cfc7e0b62 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.394478 Nov 25 08:43:08.597181 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 249/489] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:08 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:08.617708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:08.620924 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:08.623439 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5111b264-8360-490e-aa0d-8a716955e688 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.509106 Nov 25 08:43:08.625465 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 241/490] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:08 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:08.721111 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:08.721625 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:08.723049 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:08.727400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:08.739772 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.740140 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.740611 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.742070 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.742527 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.743219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.744887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:08.746002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:08.858598 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Going to try to terminate instance {{(pid=122643) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:43:08.976895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:08.976895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-26ca3235-36f2-48f3-b9cc-91975999bd36 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.264108 Nov 25 08:43:08.995827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 250/491] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:08 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:09.099635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3e034d34-ae99-401c-bb95-9038cb197368 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 204 len: 0 microversion: 2.1 time: 0.386435 Nov 25 08:43:09.099635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 242/492] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:43:08 2021] DELETE /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:43:09.107599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:09.108657 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:09.118333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:09.119129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:09.120704 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:09.121457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:09.342225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:09.354562 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-16fe372f-898f-4fff-9347-828363237784 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1513 microversion: 2.1 time: 0.250649 Nov 25 08:43:09.355404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 251/493] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:09 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:09.606353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:09.607953 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:09.618472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:09.619255 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:09.620487 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:09.621657 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:09.659398 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:09.664658 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:09.678117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:09.680462 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:09.682329 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:09.683155 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:09.957388 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:09.978043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-aaccb595-169b-41c4-b1be-9c17ae14329e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.375642 Nov 25 08:43:09.979883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 243/494] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:09 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:09.995366 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:09.996841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:10.013035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:10.014040 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:10.015680 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:10.016604 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:10.042792 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:10.052688 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:10.054781 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:10.056076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6a8e90aa-1911-4c63-afd3-db9c5b3d06dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.404605 Nov 25 08:43:10.058300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 252/495] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:09 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:10.254764 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:10.269906 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8dc217e1-12c5-478e-9a38-906642c76898 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.282015 Nov 25 08:43:10.270984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 244/496] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:09 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:10.380976 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:10.383236 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:10.399427 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:10.403043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:10.406195 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:10.407843 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:10.672615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:10.686746 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d6c5e3e8-7735-4334-a8da-8fe5f9c69705 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1513 microversion: 2.1 time: 0.313517 Nov 25 08:43:10.687354 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 253/497] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:10 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:11.001688 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:11.002822 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:11.017106 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.018242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.019711 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.020521 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.088105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:11.089692 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:11.102311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.106645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.106645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.106645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.399429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:11.421041 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dbc6e7fe-8a91-40ad-9c1e-7612f5a7f044 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1721 microversion: 2.1 time: 0.425806 Nov 25 08:43:11.421859 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 245/498] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:10 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1721 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:11.430315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:11.431227 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:11.447744 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.450783 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.452072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.453803 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.454875 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:11.470232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:11.473266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:11.475055 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7ce35fae-9454-4ea8-8a5e-c0d61996e272 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.394395 Nov 25 08:43:11.476773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 254/499] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:11 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:11.718337 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:11.719314 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:11.733065 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.733989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.737226 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:11.738029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:11.780561 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:11.790503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-61e49a9d-e776-4fae-bc94-770f20a8eed7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.367458 Nov 25 08:43:11.791108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 246/500] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:11 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:12.315085 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:12.330016 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c7d7298d-618c-49fb-8a50-933d17b751ff tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1513 microversion: 2.1 time: 0.620111 Nov 25 08:43:12.331506 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 255/501] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:11 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1513 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:12.454463 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:12.455269 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:12.471404 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:12.471889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:12.472817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:12.473287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:12.536520 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:12.537067 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:12.575451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:12.576287 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:12.578016 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:12.578789 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:12.843332 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:12.869881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b3caba86-81a4-4309-a683-265af04614e2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1698 microversion: 2.1 time: 0.417144 Nov 25 08:43:12.871449 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 247/502] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:12 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1698 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:12.893026 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:12.893834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:12.922112 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:12.923930 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:12.931786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:12.932402 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:13.726780 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:13.751720 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:13.758116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:13.760690 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-83ed3570-3c5c-440b-bd1d-757ece9b4fe4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 1.232152 Nov 25 08:43:13.777979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 256/503] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:12 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:13.786592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c6836db5-599a-4dd9-8e3c-cb613f91c92c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:13.816787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c6836db5-599a-4dd9-8e3c-cb613f91c92c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:13.820836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c6836db5-599a-4dd9-8e3c-cb613f91c92c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:13.902402 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c6836db5-599a-4dd9-8e3c-cb613f91c92c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Going to try to start instance {{(pid=122641) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 25 08:43:13.948072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:13.963604 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-77b8a410-659f-4bb6-814f-4621b719b774 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 1.071801 Nov 25 08:43:13.975971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 248/504] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:12 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:13.981941 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:13.983024 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:13.990929 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:13.992038 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:13.993168 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:13.993791 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:14.040523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c6836db5-599a-4dd9-8e3c-cb613f91c92c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 202 len: 0 microversion: 2.1 time: 0.260504 Nov 25 08:43:14.041662 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 257/505] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:43:13 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:43:14.051042 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:14.051929 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:14.053518 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lazy-loading 'fault' on Instance uuid 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:43:14.062312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-03271d12-a9da-480f-9f42-23802fb86853 req-e4e0e035-1e1d-4d43-8be1-a45d4710b68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0", "name": "network-vif-deleted", "tag": "0934d921-242f-4af1-b9f6-e9d52009e97f"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:14.071162 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:43:14.071162 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:43:14.094905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-03271d12-a9da-480f-9f42-23802fb86853 req-e4e0e035-1e1d-4d43-8be1-a45d4710b68e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:14.104174 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-03271d12-a9da-480f-9f42-23802fb86853 req-e4e0e035-1e1d-4d43-8be1-a45d4710b68e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:14.161448 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-03271d12-a9da-480f-9f42-23802fb86853 req-e4e0e035-1e1d-4d43-8be1-a45d4710b68e service nova] Creating event network-vif-deleted:0934d921-242f-4af1-b9f6-e9d52009e97f for instance 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 on hv-cinder-77819 Nov 25 08:43:14.168542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:14.181631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-03271d12-a9da-480f-9f42-23802fb86853 req-e4e0e035-1e1d-4d43-8be1-a45d4710b68e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133901 Nov 25 08:43:14.182575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1a3500e6-c66c-4a2d-b11e-931a780b30d3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 200 len: 1307 microversion: 2.1 time: 0.202630 Nov 25 08:43:14.183448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 249/506] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:13 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 1307 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:14.185372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 258/507] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:43:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:14.191975 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:14.192806 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:14.200937 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:14.201766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:14.203144 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:14.204082 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:14.651512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:14.662463 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-327281b2-02b5-4990-85ea-b07ceb11aa9d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1707 microversion: 2.1 time: 0.476078 Nov 25 08:43:14.663891 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 250/508] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:14 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1707 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:14.787396 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:14.789381 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:14.804386 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:14.805567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:14.806672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:14.807377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:14.990591 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:14.992518 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:15.019162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:15.019765 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:15.024093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:15.025912 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:15.187486 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:15.215323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:15.219546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:15.220543 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f7f20e81-5116-4dd1-9c09-ac75190954c2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1742 microversion: 2.20 time: 0.441942 Nov 25 08:43:15.231598 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 259/509] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:14 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1742 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:15.231598 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:15.231598 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:15.245274 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:15.245757 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:15.254561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:15.254842 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:15.309553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] HTTP exception thrown: Instance 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 could not be found. Nov 25 08:43:15.310884 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Returning 404 to user: Instance 6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:43:15.325540 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-aae68380-2324-42bc-9215-b08d9da34631 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0" status: 404 len: 111 microversion: 2.1 time: 0.094142 Nov 25 08:43:15.328538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 260/510] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:15 2021] GET /compute/v2.1/servers/6ed87e24-cb60-4d7b-b4ad-5bea50bd3fd0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:43:15.644015 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:15.673633 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b7a98d25-0fc1-42d4-b00a-9aba18f38032 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.694601 Nov 25 08:43:15.674451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 251/511] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:14 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:15.689995 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:15.690910 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:15.698699 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:15.699948 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:15.701018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:15.701641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.231602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:16.249282 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b679cc52-5b68-4244-991c-208c648efd35 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1707 microversion: 2.1 time: 0.562999 Nov 25 08:43:16.250369 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 261/512] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:15 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1707 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:16.264980 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:16.269232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:16.289798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.290682 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.292737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.293747 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.610368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:16.613037 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:16.618023 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:16.627723 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.628703 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.629657 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.630206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.636639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:16.641481 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:16.645983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-82e00d23-39d4-496c-8bcc-5ae6a9e3fdef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1724 microversion: 2.20 time: 0.389692 Nov 25 08:43:16.648268 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 252/513] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:16 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:16.684779 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:43:16.696688 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:16.698276 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:16.711199 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.712503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.714298 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.715435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.833591 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-50e2d98a-b910-4201-8096-9422ebfc61b8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 204 len: 0 microversion: 2.1 time: 0.238708 Nov 25 08:43:16.835441 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 262/514] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:43:16 2021] DELETE /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:43:16.844609 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:16.845356 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:16.852976 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.853427 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:16.854262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:16.854722 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:17.081197 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:17.110076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c5040119-6853-40d2-a24a-fc1be596ba65 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.410725 Nov 25 08:43:17.111433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 253/515] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:16 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:17.261714 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:17.270830 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8a961d34-b12c-4081-8ae7-641faa2d32e0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1512 microversion: 2.1 time: 0.430317 Nov 25 08:43:17.282843 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 263/516] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:16 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:17.283350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:17.285442 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:17.297473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:17.299136 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:17.301300 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:17.302123 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:17.338365 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-d383beb7-ad8f-4a55-84c4-7c2430512c22 req-c218ee8f-5389-44f9-82ae-0572b4a49b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e5c47-a03f-44f8-8181-954812e9b38b", "name": "network-vif-unplugged", "status": "completed", "tag": "e813642c-c46b-4870-94db-1582911a9fad"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:17.341452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:43:17.341452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:43:17.357876 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d383beb7-ad8f-4a55-84c4-7c2430512c22 req-c218ee8f-5389-44f9-82ae-0572b4a49b6e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:17.359404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d383beb7-ad8f-4a55-84c4-7c2430512c22 req-c218ee8f-5389-44f9-82ae-0572b4a49b6e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:17.378768 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-d383beb7-ad8f-4a55-84c4-7c2430512c22 req-c218ee8f-5389-44f9-82ae-0572b4a49b6e service nova] Creating event network-vif-unplugged:e813642c-c46b-4870-94db-1582911a9fad for instance 861e5c47-a03f-44f8-8181-954812e9b38b on hv-cinder-77819 Nov 25 08:43:17.391230 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-d383beb7-ad8f-4a55-84c4-7c2430512c22 req-c218ee8f-5389-44f9-82ae-0572b4a49b6e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057609 Nov 25 08:43:17.393723 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 264/517] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:43:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:17.502493 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:17.519407 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-714c2250-ecd4-456b-8b9d-d229f5e92290 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1711 microversion: 2.1 time: 0.243092 Nov 25 08:43:17.520468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 254/518] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:17 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1711 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:17.667979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:17.668691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:17.675884 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:17.676335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:17.677140 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:17.677578 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:17.903336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:17.916588 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:17.919651 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:17.922469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0128f55e-2cd0-4717-862b-252e87a47ee8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1724 microversion: 2.20 time: 0.258934 Nov 25 08:43:17.936572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 265/519] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:17 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:18.144383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:18.145391 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:18.169325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:18.169766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:18.170578 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:18.171160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:18.291690 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:18.292434 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:18.299728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:18.300553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:18.301375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:18.304687 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:18.423380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:18.436166 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dec8b74e-c3e5-4e07-81c6-6ee007a957fd tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.298599 Nov 25 08:43:18.449041 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 255/520] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:18 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:18.569972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:18.579701 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-66335de5-7d1c-4fff-a85f-5c5790746167 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1512 microversion: 2.1 time: 0.294365 Nov 25 08:43:18.580289 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 266/521] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:18 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:18.954760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:18.956360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:18.965908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:18.966362 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:18.967175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:18.967659 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:19.141580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:19.160372 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:19.163630 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:19.165866 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7e610e53-bbf9-4f7d-bc1a-56d56d4c9c3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1724 microversion: 2.20 time: 0.218314 Nov 25 08:43:19.167617 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 256/522] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:18 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:19.455798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:19.457172 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:19.482412 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:19.483009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:19.484700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:19.485629 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:19.611636 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:19.611636 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:19.613739 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:19.614606 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:19.616209 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:19.617058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:19.980192 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:19.996895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cb921b37-9943-4655-a036-1eccae097aa8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.545382 Nov 25 08:43:19.997506 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 267/523] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:19 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:20.017428 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:20.030669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-aa97646d-6199-410c-bd81-2dd0c49d5843 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1512 microversion: 2.1 time: 0.436487 Nov 25 08:43:20.034204 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 257/524] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:19 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:20.193130 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:20.195597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:20.217353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:20.217353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:20.217353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:20.217353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:20.528498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:20.577227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:20.579197 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:20.584445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6b5e424a-4070-470b-8413-acb5c9fc7dc8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1727 microversion: 2.20 time: 0.398602 Nov 25 08:43:20.601438 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 268/525] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:20 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1727 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:20.628836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-63d0a38f-0e4d-4301-a051-37f38e38b63c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "163a40bd-6dc1-4bf3-9008-2e9a2727f379"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:20.633641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-63d0a38f-0e4d-4301-a051-37f38e38b63c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:20.659388 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-63d0a38f-0e4d-4301-a051-37f38e38b63c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:20.661274 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-63d0a38f-0e4d-4301-a051-37f38e38b63c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:20.663678 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-63d0a38f-0e4d-4301-a051-37f38e38b63c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:20.664848 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-63d0a38f-0e4d-4301-a051-37f38e38b63c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:20.820031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-baf175ca-08e3-42d0-8481-7237b463b2b7 req-38a38124-5ae0-44a9-9ece-cd6cfc3b595d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6594bd69-10bc-4a9f-a5d8-9c110620ed10", "name": "network-vif-deleted", "tag": "f9029ad7-c8b8-4982-81e2-c65eb84cab9b"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:20.821601 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:43:20.821601 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:43:20.837194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-baf175ca-08e3-42d0-8481-7237b463b2b7 req-38a38124-5ae0-44a9-9ece-cd6cfc3b595d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:20.837936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-baf175ca-08e3-42d0-8481-7237b463b2b7 req-38a38124-5ae0-44a9-9ece-cd6cfc3b595d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:20.858124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-baf175ca-08e3-42d0-8481-7237b463b2b7 req-38a38124-5ae0-44a9-9ece-cd6cfc3b595d service nova] Creating event network-vif-deleted:f9029ad7-c8b8-4982-81e2-c65eb84cab9b for instance 6594bd69-10bc-4a9f-a5d8-9c110620ed10 on hv-cinder-77819 Nov 25 08:43:20.867542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-baf175ca-08e3-42d0-8481-7237b463b2b7 req-38a38124-5ae0-44a9-9ece-cd6cfc3b595d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052207 Nov 25 08:43:20.869661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 269/526] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:43:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:21.020191 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:21.024616 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:21.035833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:21.036614 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:21.038567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:21.039199 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:21.639486 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:21.684977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6e9a7583-4b4c-43b2-bdb8-174e08a5547d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.667324 Nov 25 08:43:21.686046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-63d0a38f-0e4d-4301-a051-37f38e38b63c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.082008 Nov 25 08:43:21.689841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 258/527] 10.222.0.46 () {62 vars in 1363 bytes} [Thu Nov 25 08:43:20 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments => generated 188 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:43:21.699214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 270/528] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:21 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:21.730888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:21.731981 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:21.765567 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:21.766871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:21.768994 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:21.770050 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:21.861488 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:21.862324 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:21.863043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lazy-loading 'fault' on Instance uuid 6594bd69-10bc-4a9f-a5d8-9c110620ed10 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:43:21.914959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:21.923938 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-eb56363d-4d93-4597-9040-d7cad2a4ce05 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 200 len: 1307 microversion: 2.1 time: 0.229149 Nov 25 08:43:21.925374 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 259/529] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:21 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:22.014329 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c6d36221-74b6-4879-bc46-945e08258efa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:22.015252 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c6d36221-74b6-4879-bc46-945e08258efa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:22.025335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c6d36221-74b6-4879-bc46-945e08258efa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.026134 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c6d36221-74b6-4879-bc46-945e08258efa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.027764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c6d36221-74b6-4879-bc46-945e08258efa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.028792 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c6d36221-74b6-4879-bc46-945e08258efa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.172465 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c6d36221-74b6-4879-bc46-945e08258efa tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action" status: 202 len: 0 microversion: 2.20 time: 0.170258 Nov 25 08:43:22.173478 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 271/530] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:43:22 2021] POST /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:43:22.194654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:22.195838 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:22.206519 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.207274 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.209603 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.210210 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.426250 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:22.460681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:22.464180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:22.466678 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ebd2c483-9954-4256-8bbf-7b36adbf58c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1753 microversion: 2.20 time: 0.284284 Nov 25 08:43:22.477355 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 260/531] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:22 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1753 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:22.724382 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:22.727078 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:22.740677 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.742647 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.743598 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.744110 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.963902 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:22.965273 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 6594bd69-10bc-4a9f-a5d8-9c110620ed10] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:22.975719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.976430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.976988 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:22.977435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:22.999340 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:23.003224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] HTTP exception thrown: Instance 6594bd69-10bc-4a9f-a5d8-9c110620ed10 could not be found. Nov 25 08:43:23.003856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Returning 404 to user: Instance 6594bd69-10bc-4a9f-a5d8-9c110620ed10 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:43:23.004707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-94ab7ed9-5349-4d61-bdc0-af9276d75449 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10" status: 404 len: 111 microversion: 2.1 time: 0.055174 Nov 25 08:43:23.005899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 261/532] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:22 2021] GET /compute/v2.1/servers/6594bd69-10bc-4a9f-a5d8-9c110620ed10 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:43:23.019515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e0bebc63-b2a2-4511-8049-3f1517beb2de tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.303059 Nov 25 08:43:23.031525 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 272/533] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:22 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:23.036048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:23.036858 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:23.063979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:23.068987 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:23.074261 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:23.082212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:23.132472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Going to try to terminate instance {{(pid=122643) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:43:23.312223 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1ccfb393-1694-45f7-a0d3-55e34c93947a tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 204 len: 0 microversion: 2.1 time: 0.298109 Nov 25 08:43:23.313063 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 262/534] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:43:23 2021] DELETE /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:43:23.325033 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:23.326186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:23.335373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:23.335987 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:23.337111 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:23.337751 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:23.498157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:23.498861 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:23.512296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:23.512765 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:23.513763 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:23.514195 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:23.647864 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:23.669808 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9470e6fc-7616-4d4d-a6a6-cd68234af52d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1512 microversion: 2.1 time: 0.351276 Nov 25 08:43:23.671443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 273/535] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:23 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:23.796950 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:23.807310 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:23.809115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:23.810341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-72a891b3-940a-485f-8a7b-1f2158e70c4e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1753 microversion: 2.20 time: 0.316494 Nov 25 08:43:23.810916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 263/536] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:23 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1753 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:24.039553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:24.040942 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:24.049613 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:24.050360 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:24.051352 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:24.052136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:24.472779 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:24.488997 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-31d83749-617d-47ba-b6a5-09b3b6e8499e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.454545 Nov 25 08:43:24.491120 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 274/537] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:24 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:24.699020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:24.700182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:24.727913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:24.728733 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:24.730164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:24.741445 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:24.846497 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:24.847681 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:24.893773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:24.900796 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:24.911693 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:24.913346 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:25.030544 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:25.046299 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dcc6c2a7-b201-4599-ac6b-fa41a79340d6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1512 microversion: 2.1 time: 0.356285 Nov 25 08:43:25.046908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 264/538] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:24 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1512 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:25.262993 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-58c2ccac-fe0d-47d1-95bf-98974ad37b16 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Action: 'create', calling method: .version_select at 0x7f97086914c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1151699040"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:25.273017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:25.283062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:25.285052 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:25.286670 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-af700bf8-c0ec-4b3e-b0fc-7f65f5980a00 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1755 microversion: 2.20 time: 0.448738 Nov 25 08:43:25.290693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-58c2ccac-fe0d-47d1-95bf-98974ad37b16 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Getting quotas for project 2dc4103c9eb443549b5e374c148eae92. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:43:25.292308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 275/539] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:24 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1755 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:25.299981 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-58c2ccac-fe0d-47d1-95bf-98974ad37b16 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Getting quotas for user 3fb5977a4a204af69fb9a90930a89457 and project 2dc4103c9eb443549b5e374c148eae92. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:43:25.516052 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:25.516955 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:25.524099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:25.524850 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:25.525851 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:25.526475 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:25.563792 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-58c2ccac-fe0d-47d1-95bf-98974ad37b16 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Getting quotas for project 2dc4103c9eb443549b5e374c148eae92. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:43:25.569371 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-58c2ccac-fe0d-47d1-95bf-98974ad37b16 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Getting quotas for user 3fb5977a4a204af69fb9a90930a89457 and project 2dc4103c9eb443549b5e374c148eae92. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:43:25.587340 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-58c2ccac-fe0d-47d1-95bf-98974ad37b16 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.327826 Nov 25 08:43:25.588298 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 265/540] 10.222.0.46 () {60 vars in 1157 bytes} [Thu Nov 25 08:43:25 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:25.670429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-477769314", "imageRef": "9db9c0f4-b156-441c-b2e7-f0340d023ec8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1151699040", "networks": [{"uuid": "64b7c388-d5ad-48f5-90fd-d84255829a54"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:25.750566 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] validate_networks() for [('64b7c388-d5ad-48f5-90fd-d84255829a54', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:43:26.246243 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:26.261401 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9a048029-d84a-4317-b774-ecf58dfef659 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.749006 Nov 25 08:43:26.264415 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 276/541] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:25 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:26.270674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:26.272808 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:26.281847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:26.283612 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:26.284673 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:26.285234 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:26.805784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:26.817449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5df546b4-4a05-4d31-8b38-1fbb4bcf17ab tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1512 microversion: 2.1 time: 0.551245 Nov 25 08:43:26.819378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 277/542] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:26 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1512 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:26.839084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:26.839893 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:26.853785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:26.854400 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:26.857626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:26.858429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.117436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:43:27.118171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:43:27.119691 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:43:27.120881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:43:27.122988 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:43:27.151517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.152441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.155220 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.155849 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.205303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Getting quotas for project 2dc4103c9eb443549b5e374c148eae92. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:43:27.210758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Getting quotas for user 3fb5977a4a204af69fb9a90930a89457 and project 2dc4103c9eb443549b5e374c148eae92. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:43:27.228707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:43:27.232466 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9db9c0f4-b156-441c-b2e7-f0340d023ec8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:43:27.255186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:27.265110 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:27.266948 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:27.269621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1bcff025-030f-45cf-9492-cda3ec9698bd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.439924 Nov 25 08:43:27.270489 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 278/543] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:26 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:27.288586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-96ee1918-31e2-45bc-aabb-0e1470ab9788 req-40d112f3-2c61-4bf4-bb42-13558edbfb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bea85b-e08a-4c45-9bc6-b587de1413a5", "name": "network-vif-deleted", "tag": "3d904caf-5740-4806-9e49-0bff89308ad2"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:27.291469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:43:27.291469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:43:27.299636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-96ee1918-31e2-45bc-aabb-0e1470ab9788 req-40d112f3-2c61-4bf4-bb42-13558edbfb92 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.300361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-96ee1918-31e2-45bc-aabb-0e1470ab9788 req-40d112f3-2c61-4bf4-bb42-13558edbfb92 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.323771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-96ee1918-31e2-45bc-aabb-0e1470ab9788 req-40d112f3-2c61-4bf4-bb42-13558edbfb92 service nova] Creating event network-vif-deleted:3d904caf-5740-4806-9e49-0bff89308ad2 for instance 80bea85b-e08a-4c45-9bc6-b587de1413a5 on hv-cinder-77819 Nov 25 08:43:27.331157 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-96ee1918-31e2-45bc-aabb-0e1470ab9788 req-40d112f3-2c61-4bf4-bb42-13558edbfb92 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046575 Nov 25 08:43:27.332104 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 279/544] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:43:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:27.340218 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:27.341129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:27.341266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ca8becc2-0044-4d89-afbe-7468b07feca0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.673187 Nov 25 08:43:27.342617 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 266/545] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:43:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 25 08:43:27.362503 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.363264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.363592 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a7effe03-c4dc-45b9-8b96-c604c892ee2b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:27.364459 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.365212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.365494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a7effe03-c4dc-45b9-8b96-c604c892ee2b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:27.487950 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a7effe03-c4dc-45b9-8b96-c604c892ee2b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:27.499356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a7effe03-c4dc-45b9-8b96-c604c892ee2b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1258 microversion: 2.1 time: 0.146801 Nov 25 08:43:27.500336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 267/546] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:27 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:27.579498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:27.589832 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-45091c77-0026-4b59-aed2-669abcbffc4e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.256254 Nov 25 08:43:27.592237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 280/547] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:27 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:27.836762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:27.837450 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:27.845931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.847641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.852862 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.853386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.910844 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:27.911624 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:27.912803 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lazy-loading 'fault' on Instance uuid 80bea85b-e08a-4c45-9bc6-b587de1413a5 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:43:28.036343 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:28.048542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4db86c56-5aa4-4fd0-be6e-f4879b62f981 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 200 len: 1307 microversion: 2.1 time: 0.215626 Nov 25 08:43:28.059711 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 268/548] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:27 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 1307 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:28.289982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:28.290671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:28.305447 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:28.306695 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:28.307871 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:28.308515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:28.519594 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:28.522080 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:28.533252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:28.534574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:28.536653 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:28.538813 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:28.698615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:28.728715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1b7bc700-82e7-40df-a441-afc00850bfb1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.213548 Nov 25 08:43:28.729976 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 269/549] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:28 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:28.735336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:28.736338 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:28.749024 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:28.749868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:28.750886 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:28.754273 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:28.792462 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:28.810323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:28.814027 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:28.816815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8b2fa637-4b28-42d3-9599-326f4be77f0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.530547 Nov 25 08:43:28.835752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 281/550] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:28 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:28.980552 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:28.988665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c1f406af-24cf-44ef-8498-03270967790b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.257274 Nov 25 08:43:28.989250 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 270/551] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:28 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:29.073373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:29.074346 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 80bea85b-e08a-4c45-9bc6-b587de1413a5] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:29.082684 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:29.083133 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:29.084411 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:29.085108 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:29.103302 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] HTTP exception thrown: Instance 80bea85b-e08a-4c45-9bc6-b587de1413a5 could not be found. Nov 25 08:43:29.104285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Returning 404 to user: Instance 80bea85b-e08a-4c45-9bc6-b587de1413a5 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:43:29.105490 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9fe377c9-9148-495b-a840-c12cd22d4ce6 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5" status: 404 len: 111 microversion: 2.1 time: 0.040383 Nov 25 08:43:29.106303 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 282/552] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:29 2021] GET /compute/v2.1/servers/80bea85b-e08a-4c45-9bc6-b587de1413a5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:43:29.750431 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:29.751272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:29.758466 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:29.758952 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:29.759788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:29.760224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:29.825044 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:29.839105 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6f99fbbc-eae4-4eee-94a2-43d3f92a9d0c tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.092001 Nov 25 08:43:29.840577 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 271/553] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:29 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:29.846281 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:29.846920 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:29.853970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:29.854425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:29.855212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:29.855665 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.002210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:30.009788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:30.010627 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:30.024468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.025590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.025789 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:30.027662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.028667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.029135 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:30.031799 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d4b8cad2-ef98-4f8f-8be7-ce0d152dc1d7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.189028 Nov 25 08:43:30.033165 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 283/554] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:29 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:30.313141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:30.316409 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:30.331166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.332440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.334848 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.336608 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.340751 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:30.352977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-eba9d6ae-9410-484e-ab8e-c7dd56328ad6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.350177 Nov 25 08:43:30.359837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 272/555] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:30 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:30.382095 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:43:30.496079 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0e9b1259-c5b9-461c-8b4c-d7175cbe3ced tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "DELETE /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 204 len: 0 microversion: 2.1 time: 0.190659 Nov 25 08:43:30.500659 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 284/556] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:43:30 2021] DELETE /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:43:30.511058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:30.512607 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:30.526466 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.527316 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.529502 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.531541 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.773649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:30.781829 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9a680c2a-cab2-4f5a-99ee-31b9f326b779 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.279341 Nov 25 08:43:30.782306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 273/557] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:30 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:30.862503 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:30.863310 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:30.870717 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.871162 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.871994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:30.872424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:30.961720 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:30.975961 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f3e848dc-d5d9-49f9-b3e6-86f642605298 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.116814 Nov 25 08:43:30.977151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 285/558] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:30 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:31.060306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:31.060895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:31.067108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:31.067548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:31.068565 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:31.069041 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:31.216625 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:31.227050 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:31.228654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:31.229923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-80f8e6b2-14e5-477c-b828-58dad9ce38a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.173640 Nov 25 08:43:31.230620 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 274/559] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:31 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:31.372148 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:31.372764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:31.380677 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:31.381101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:31.382104 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:31.382579 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:31.564122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:31.590213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-21f224bd-76c3-4f89-b30b-37b0d2ae1d76 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.222434 Nov 25 08:43:31.591784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 286/560] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:31 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:31.799499 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:31.800152 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:31.807131 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:31.807595 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:31.808400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:31.808832 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:31.964478 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:31.972615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5a62370c-4c8b-4541-bfb7-cf82284c0ca3 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.176734 Nov 25 08:43:31.973207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 275/561] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:31 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:32.000920 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:32.001802 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:32.008935 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:32.009399 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:32.010209 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:32.010649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:32.078298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:32.087640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0ad1470f-047a-4bb7-a51f-b9e0d502e067 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.090291 Nov 25 08:43:32.088229 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 287/562] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:31 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:32.248914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:32.249451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:32.257171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:32.257649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:32.258483 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:32.258924 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:32.407058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:32.416304 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:32.417835 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:32.419024 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-67a2c29a-9377-4516-9ba0-72543889189a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.173943 Nov 25 08:43:32.419615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 276/563] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:32 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:32.611661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:32.612424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:32.625599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:32.626428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:32.628040 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:32.628834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:32.848305 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:32.857794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7bd77450-5456-40ca-a6c5-eea21ba414fc tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.251109 Nov 25 08:43:32.858391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 288/564] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:32 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:32.991594 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:32.992284 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:33.001600 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.002397 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:33.003825 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.004586 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:33.111552 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:33.112698 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:33.125608 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.125936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:33.127871 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.128326 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:33.216773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:33.217504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:33.227735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0e5dc22a-9e24-47fa-bdfd-2d28c01c0445 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.121009 Nov 25 08:43:33.237551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a06a439c-a77c-4349-8090-c5fb16f4d95f tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.242490 Nov 25 08:43:33.238359 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 289/565] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:33 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:33.245005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 277/566] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:32 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:33.446278 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:33.446892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:33.453441 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.453888 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:33.454691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.455127 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:33.609640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:33.625960 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:33.629225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:33.632229 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ed609533-340a-486e-8c1d-1f5d80291d97 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.189662 Nov 25 08:43:33.633343 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 290/567] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:33 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:33.886479 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:33.887608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:33.895686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.897554 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:33.898208 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:33.898671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:34.101331 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:34.109642 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-41ae6fbf-1237-4b66-89cb-2bcdd8b02035 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.230708 Nov 25 08:43:34.110237 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 278/568] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:33 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:34.245296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:34.246023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:34.252776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:34.253371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:34.254306 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:34.254840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:34.256515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:34.257268 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:34.265258 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:34.266162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:34.267135 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:34.267687 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:34.346396 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:34.361451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-545241ef-ac2a-4fe4-b8ff-db41c7022149 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.119369 Nov 25 08:43:34.362571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 291/569] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:34 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:34.454762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:34.465956 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fb9c2432-af09-43c2-a592-348829d1bec7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.211752 Nov 25 08:43:34.465956 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 279/570] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:34 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:34.653994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:34.654888 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:34.662515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:34.663169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:34.664162 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:34.664732 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:34.865163 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:34.888829 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:34.890977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:34.892780 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cf6ec1ab-cb26-4241-b0ac-912961d328eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.243218 Nov 25 08:43:34.893577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 292/571] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:34 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:35.132540 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:35.133746 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:35.147295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.148212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:35.149998 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.150828 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:35.386532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:35.388819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:35.404017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.405206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:35.407265 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.408383 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:35.428261 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:35.444784 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-aa8ad108-545a-4db2-ba4f-cf9288da1104 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.318050 Nov 25 08:43:35.463600 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 280/572] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:35 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:35.484392 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:35.485301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:35.497235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.499096 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:35.500836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.501470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:35.526889 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:35.541179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a0782153-ecc6-4a2e-8119-e29505057829 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.162509 Nov 25 08:43:35.542263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 293/573] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:35 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:35.721179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:35.732152 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-17dc21ce-f84a-433d-8f3f-e51021c75880 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.252915 Nov 25 08:43:35.732847 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 281/574] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:35 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:35.913204 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:35.913811 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:35.920381 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.920905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:35.921771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:35.922212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:36.136640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:36.155902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:36.164539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:36.167823 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e145bc0a-7037-4bb5-9763-43d2cf492763 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.258390 Nov 25 08:43:36.169169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 294/575] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:35 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:36.474712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:36.475782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:36.483462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:36.484036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:36.484876 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:36.485351 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:36.571840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:36.573258 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:36.584559 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:36.585885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:36.587362 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:36.588348 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:36.715725 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:36.722742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:36.737595 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3c5bcc2a-2d23-4263-b653-0443452f2343 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.169970 Nov 25 08:43:36.738555 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 295/576] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:36 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:36.742682 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ce434a1b-efd2-43da-a936-52cc734d9cc6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.272172 Nov 25 08:43:36.743923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 282/577] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:36 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:36.758849 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:36.759761 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:36.766417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:36.766867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:36.767699 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:36.768136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:36.940159 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:36.956698 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-00134f8e-2925-457d-bcca-093b3b6ee765 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.201417 Nov 25 08:43:36.958423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 296/578] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:36 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:37.194978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:37.195811 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:37.204242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:37.205098 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:37.206671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:37.207435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:37.416139 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:37.425460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:37.427848 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:37.429646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-18af4b36-9448-46fc-b70f-870a07ec2e7a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.239523 Nov 25 08:43:37.430432 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 283/579] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:37 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:37.756269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:37.756907 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:37.763756 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:37.764199 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:37.764983 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:37.765402 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:37.770527 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:37.771665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:37.778993 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:37.779513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:37.780531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:37.781050 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:37.857209 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:37.872283 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-df770b30-ab34-479e-915f-fe8b263f33f2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.119768 Nov 25 08:43:37.873698 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 297/580] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:37 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:37.979804 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:37.987620 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:37.988244 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:37.997790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:37.998535 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:37.998802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-15e14592-c354-4136-a691-b5370865d354 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.229881 Nov 25 08:43:38.000294 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:38.002944 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:38.009770 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 284/581] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:37 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:38.213394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:38.226737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-95653740-dd5e-4535-a9dc-6df6d2d05fb8 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.245181 Nov 25 08:43:38.236364 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 298/582] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:37 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:38.455963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:38.457178 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:38.465018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:38.465475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:38.466288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:38.466717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:38.672020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:38.686535 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:38.689680 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:38.691775 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8a0d82e8-e7a8-4eba-8644-9d0ca02d8b95 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.242892 Nov 25 08:43:38.692951 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 285/583] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:38 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:38.899202 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:38.900152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:38.907265 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:38.908022 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:38.909093 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:38.909567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:39.020369 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:39.037332 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:39.038233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5161ddb7-9828-4766-9c67-520179fd4dfe tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.141714 Nov 25 08:43:39.039547 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:39.052764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 299/584] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:38 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:39.058085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:39.059429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:39.061480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:39.062333 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:39.253944 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:39.255833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:39.274622 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:39.276986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:39.277519 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:39.278358 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:39.278786 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:39.289236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-827eba92-67c8-4b85-9ee6-534685fc366a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.268946 Nov 25 08:43:39.290073 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 286/585] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:39 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:39.519378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:39.532046 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-bdc5b0b4-04e8-4687-a829-f0d494b7608c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.282466 Nov 25 08:43:39.533007 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 300/586] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:39 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:39.714894 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:39.716513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:39.728773 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:39.729705 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:39.731244 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:39.732147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:39.963786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:39.987615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:39.992392 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:39.996030 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-427feb9a-932b-4152-88c7-224a47e0af90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.286723 Nov 25 08:43:39.998093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 287/587] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:39 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:40.069961 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:40.071389 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:40.078305 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:40.078755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:40.079649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:40.080034 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:40.162365 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:40.172432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-62f4eeb5-a6e2-4a1b-bfcf-a5b41ff18ad5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.109693 Nov 25 08:43:40.173037 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 301/588] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:40 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:40.307145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:40.308161 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:40.314787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:40.315238 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:40.316073 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:40.316512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:40.491452 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:40.499907 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8c7cc3a0-2aa6-4551-b306-46a844e1ee27 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.196585 Nov 25 08:43:40.500496 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 288/589] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:40 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:40.556699 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:40.557378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:40.563788 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:40.564240 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:40.565042 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:40.565478 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:40.718621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:40.728851 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-abeffbaf-fe33-498e-bfd5-3465a1a161a4 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.175942 Nov 25 08:43:40.739361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 302/590] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:40 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:41.037658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:41.038841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:41.045235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.045675 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:41.046519 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.046943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:41.191512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:41.192314 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:41.196331 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:41.199568 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.200053 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:41.200943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.201391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:41.205665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:41.207171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:41.209204 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8d553af2-76d8-46a4-9741-b6c56182a8b4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.175534 Nov 25 08:43:41.209802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 289/591] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:41 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:41.267342 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:41.275176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-92e7c66a-0619-4fc1-9ce0-862aa4f9ac7d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.087938 Nov 25 08:43:41.275830 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 303/592] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:41 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:41.518144 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:41.518808 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:41.525912 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.526353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:41.527153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.527612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:41.731509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:41.739536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ac3dcadb-a2cc-4422-9c83-6a7da5007e10 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.224982 Nov 25 08:43:41.740226 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 290/593] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:41 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:41.746592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:41.747198 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:41.753427 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.753872 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:41.754652 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:41.755164 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:42.188200 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:42.197535 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e1c8a84b-eabc-41b2-90b7-2fb15c0868b0 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.454557 Nov 25 08:43:42.198347 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 304/594] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:41 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:42.229107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:42.229843 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:42.237242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:42.237806 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:42.238729 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:42.239297 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:42.297600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:42.298362 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:42.307993 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:42.308875 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:42.310086 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:42.310732 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:42.402339 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:42.409716 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-35b9941b-665b-44fd-916e-4eaa6e755bee tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1262 microversion: 2.1 time: 0.117032 Nov 25 08:43:42.410296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 305/595] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:42 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:42.411931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:42.427896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:42.430811 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:42.433081 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c13741ed-00e9-40e8-a075-ca3b2e60ea5c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.207563 Nov 25 08:43:42.434138 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 291/596] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:42 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:42.757962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:42.758457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:42.765129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:42.765573 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:42.766393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:42.766953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:42.915415 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:42.923504 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-344daaec-8fa4-4cf6-8159-b59377a72696 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.170327 Nov 25 08:43:42.924115 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 306/597] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:42 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:43.216672 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:43.217336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:43.224915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.225336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:43.226140 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.226576 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:43.391441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:43.400187 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a92a427e-7800-42cf-8d88-4b997c08e98c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.187080 Nov 25 08:43:43.401135 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 292/598] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:43 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:43.430491 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:43.431636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:43.444643 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.445203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:43.446120 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.446684 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:43.463291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:43.464043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:43.473129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.474958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:43.476529 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.477256 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:43.543847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:43.557833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-afdaa236-18f1-45a1-bf3b-cda44eca04b3 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1254 microversion: 2.1 time: 0.133615 Nov 25 08:43:43.558885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 307/599] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:43 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1254 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:43.678367 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:43.688116 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:43.690025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:43.691896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7b115c8c-c7e1-49ab-9a80-c75f7879ed77 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.234285 Nov 25 08:43:43.694294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 293/600] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:43 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:43.941785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:43.942458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:43.949906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.950471 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:43.951333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:43.951867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:44.264794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:44.277175 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8eb42dbd-9223-4e39-ac7a-b8b798819175 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.339040 Nov 25 08:43:44.278276 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 308/601] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:43 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:44.422361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:44.423591 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:44.436266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:44.437246 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:44.438608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:44.439448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:44.582150 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:44.584852 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:44.597043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:44.598387 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:44.600989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:44.601925 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:44.717362 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:44.733010 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d69b9ade-23fa-4d47-beed-4b1c852f7def tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.317597 Nov 25 08:43:44.734020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 294/602] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:44 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:44.742395 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:44.743260 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:44.750500 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:44.751307 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:44.752342 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:44.752926 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:44.781968 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:44.800288 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e30ff981-64ef-4166-9a2a-0e17de89ac5a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1316 microversion: 2.1 time: 0.227103 Nov 25 08:43:44.801860 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 309/603] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:44 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:45.225696 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:45.241703 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:45.244910 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:45.260434 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f7c25c47-1640-44fa-bf15-195a92ffd9b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.509641 Nov 25 08:43:45.261877 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 295/604] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:44 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:45.303529 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:45.307430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:45.315347 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:45.315787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:45.316692 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:45.317261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:45.763312 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:45.764287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:45.778335 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:45.779297 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:45.780884 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:45.781578 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:45.782507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:45.816221 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c1fc2307-f03d-493b-8156-17d9f2f6db19 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.511705 Nov 25 08:43:45.817763 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 310/605] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:45 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:45.844631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:45.851731 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:45.871958 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:45.873104 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:45.881451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:45.882552 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:46.152245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:46.165914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e821278f-a33a-4663-9ed8-5fc92271c720 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.404746 Nov 25 08:43:46.167473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 296/606] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:45 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:46.224441 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:46.239008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a3436ac2-70e3-4324-b308-4a8d70807fa2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.400836 Nov 25 08:43:46.240516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 311/607] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:45 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:46.280922 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:46.281995 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:46.290116 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:46.290851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:46.291915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:46.292367 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:46.492665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:46.508494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:46.511291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:46.513433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-98cc1448-4394-4d10-a0cd-17e5fe3684db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.236115 Nov 25 08:43:46.524882 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 297/608] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:46 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:46.852000 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:46.853361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:46.865242 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:46.865793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:46.866777 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:46.867332 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:47.086170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:47.104417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8a95a38b-25de-45d2-881f-a59a1fe67e56 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.260240 Nov 25 08:43:47.106437 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 312/609] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:46 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:47.191436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:47.198877 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:47.211490 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:47.212530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:47.213984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:47.214760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:47.264606 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:47.265225 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:47.272978 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:47.273423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:47.274235 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:47.274672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:47.576490 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:47.608021 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:47.615437 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-38641157-e59b-4ad9-93b9-d19756028193 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.431510 Nov 25 08:43:47.616757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 298/610] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:47 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:47.624428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3782864e-a05d-4808-b246-68c665c39595 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.363449 Nov 25 08:43:47.624926 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:47.625896 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 313/611] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:47 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:47.627742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:47.639915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:47.640356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:47.641145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:47.641574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:47.857009 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:47.868397 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:47.870172 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:47.871734 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-912989dd-c2d2-4468-81c5-428d66ea35cf tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.253290 Nov 25 08:43:47.872650 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 299/612] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:47 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:48.125091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:48.126435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:48.134490 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.134930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:48.136218 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.136819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:48.349662 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:48.362898 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a3679433-e6c8-4b73-83f4-e76f364a691a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.241238 Nov 25 08:43:48.365843 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 314/613] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:48 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:48.667615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:48.671340 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:48.672706 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:48.677797 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:48.698542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.698542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:48.698542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.698542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:48.701519 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.702660 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:48.704034 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.704714 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:48.953354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:48.962565 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c9b9e046-5e8a-4601-94b1-3d7b120532a7 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.312986 Nov 25 08:43:48.963163 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 300/614] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:48 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:48.966953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:48.968193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:48.969253 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:48.976631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e300bbf9-4256-4b4c-8849-c40d6dfc1ca7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.324886 Nov 25 08:43:48.977451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 315/615] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:48 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:48.978817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.979597 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:48.981432 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:48.981768 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:49.186925 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:49.204463 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:49.207059 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:49.209982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0c440395-22e8-4bfc-8bbf-2012d131af9d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.245466 Nov 25 08:43:49.211033 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 301/616] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:48 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:49.384384 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:49.385116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:49.392605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:49.393091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:49.393977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:49.394471 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:49.609291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:49.625618 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-78bbb4f2-987f-4b9f-a3d9-309272a81281 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.245897 Nov 25 08:43:49.628563 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 316/617] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:49 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:49.982745 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:49.983836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:49.993304 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:49.993845 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:49.994969 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:49.995481 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:50.000010 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:50.001098 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:50.010998 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:50.011761 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:50.012833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:50.013571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:50.344928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:50.365615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:50.371212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e85a871e-e258-41fa-a87e-2176811cb11d tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.391561 Nov 25 08:43:50.374033 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 302/618] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:49 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:50.393246 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:50.395227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-71fc1c57-2f22-44de-a603-2904f5aa8122 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.402122 Nov 25 08:43:50.396663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:50.400603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 317/619] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:49 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:50.412072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:50.413324 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:50.415013 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:50.416204 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:50.641649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:50.652878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:50.654926 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:50.656468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cd068c75-dbd4-41ba-ba3f-6c87b10db43f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.280936 Nov 25 08:43:50.657372 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 303/620] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:50 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:50.666769 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:50.667502 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:50.678782 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:50.679311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:50.680427 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:50.680964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:50.884116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:50.893245 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-69073c0f-edef-4081-a1ea-fe3a2752223e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.230857 Nov 25 08:43:50.893854 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 318/621] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:50 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:51.415164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:51.416042 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:51.425373 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.426419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:51.426773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:51.428056 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.428442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:51.428892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:51.436473 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.437277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:51.438513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.439167 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:51.691571 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:51.703596 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d20b3595-20e3-4c26-b49c-2afe7c13cc51 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.292893 Nov 25 08:43:51.704769 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 304/622] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:51 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:51.715671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:51.725586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3d1715bf-e0e1-471e-81d0-72d1d824e16a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.303234 Nov 25 08:43:51.731199 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:51.735382 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 319/623] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:51 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:51.736390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:51.743687 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.744245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:51.745175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.745689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:51.904272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:51.917069 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:51.918566 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:51.918841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:51.919706 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:51.919855 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4768c77c-d48c-4951-8db8-bcde32db894b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.213845 Nov 25 08:43:51.920857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 305/624] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:51 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:51.929513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.930103 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:51.931138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:51.931605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:52.140528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:52.154992 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-43cd27e9-6b3a-470d-aac1-8842f8a6508e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.240069 Nov 25 08:43:52.156048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 320/625] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:51 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:52.740171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:52.743481 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:52.748954 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:52.750194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:52.753211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:52.754095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:52.756889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:52.757553 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:52.763045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:52.764458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:52.766377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:52.767299 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:53.003486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:53.012863 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f66eff67-240c-4ede-858b-5ec8114fe572 tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.281235 Nov 25 08:43:53.013453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 306/626] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:52 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:53.018604 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:53.019223 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:53.028619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:53.029162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:53.030057 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:53.030629 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:53.039368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:53.047232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2965ef20-0b76-4082-935a-5ac1c57c3d8d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.306181 Nov 25 08:43:53.050572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 321/627] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:52 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:53.178958 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:53.179721 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:53.186292 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:53.186744 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:53.187576 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:53.188018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:53.194262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:53.207381 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:53.209836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:53.211689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2e08e9c0-66bd-49ed-840e-3044bdca7f17 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.197063 Nov 25 08:43:53.212390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 307/628] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:53 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:53.441054 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:53.452651 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f636a2cc-5d56-410b-a61f-f1b75210ac90 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.278241 Nov 25 08:43:53.453554 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 322/629] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:53 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:54.037304 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:54.037304 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:54.044187 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.044638 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.045468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.045880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.068124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:54.069185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:54.092103 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.092541 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.093544 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.094202 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.366841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:54.382200 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-29a697d8-ce91-48dc-9fc3-096fdf95f30e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.349679 Nov 25 08:43:54.395963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 308/630] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:54 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:54.395963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:54.395963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:54.407001 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.407850 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.409536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.410294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.432672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:54.450267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-db33f41f-6a5b-4972-b2fa-50be2d7e0d09 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.388093 Nov 25 08:43:54.452138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 323/631] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:54 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:54.485003 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:54.486120 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:54.499094 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.499967 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.502015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:54.502804 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:54.633132 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:54.645976 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:54.650469 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:54.653385 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8c815705-13da-4f6b-b751-0f51d9a8531d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.268197 Nov 25 08:43:54.654928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 309/632] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:54 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:54.778309 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:54.788291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9acb347d-5d9d-4f1d-98f4-a7f696dd6f67 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.311747 Nov 25 08:43:54.798463 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 324/633] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:54 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:55.409319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:55.410261 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:55.419597 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.420044 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.420841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.421272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.468422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:55.469186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:55.476641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.477087 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.478032 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.478532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.610982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:55.620552 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3d843f44-3faf-4132-b657-32923fc4375c tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.214804 Nov 25 08:43:55.621353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 310/634] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:55 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:55.666121 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:55.674043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cb36a7f8-75c9-46a9-886e-76e314f9c580 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.209201 Nov 25 08:43:55.674736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 325/635] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:55 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:55.679084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:55.679724 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:55.685937 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.686375 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.687163 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.687616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.805970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:55.806614 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:55.813641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.814086 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.814897 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:55.815336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:55.857844 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:55.869443 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:55.871165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:55.872415 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-efa74200-b79f-4f83-86d6-155a9b053e55 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.197951 Nov 25 08:43:55.872987 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 311/636] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:55 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:43:55.986612 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:55.996123 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3135bb2b-40ad-4fc1-b969-3a82e1b0b136 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1569 microversion: 2.1 time: 0.194714 Nov 25 08:43:55.996716 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 326/637] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:55 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:56.642242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:56.643389 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:56.652654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:56.653261 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:56.654181 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:56.654750 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:56.696905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:56.698045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:56.717186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:56.718229 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:56.719788 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:56.720566 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:57.388882 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:57.403254 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a5e2961d-5f87-4bf1-acdc-b1fdb768ef0e tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1513 microversion: 2.1 time: 0.767897 Nov 25 08:43:57.404355 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 312/638] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:56 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1513 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:57.415394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:57.416833 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:57.420990 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:57.428516 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:57.429275 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:57.430684 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:57.431510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:57.435359 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f4907416-9d67-4357-83ec-8af27822976d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.746449 Nov 25 08:43:57.444102 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 327/639] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:56 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:43:57.447298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:57.448954 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:57.461024 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:57.461563 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:57.462351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:57.462815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:57.953311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:57.963994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-74ed3a87-b9cc-4b0d-9d39-5a75fb81e4f7 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1549 microversion: 2.1 time: 0.525168 Nov 25 08:43:57.964871 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 328/640] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:57 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1549 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:57.970828 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-d10eb887-6253-4699-b6af-66a8278339cf req-70964065-a6d1-40da-a673-c297f117ee1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a68de2-f145-457b-b76e-393073e149bb", "tag": "8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:57.973596 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:43:57.973596 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:43:57.981508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d10eb887-6253-4699-b6af-66a8278339cf req-70964065-a6d1-40da-a673-c297f117ee1b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:57.981940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d10eb887-6253-4699-b6af-66a8278339cf req-70964065-a6d1-40da-a673-c297f117ee1b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:57.995697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-d10eb887-6253-4699-b6af-66a8278339cf req-70964065-a6d1-40da-a673-c297f117ee1b service nova] Creating event network-changed:8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d for instance 91a68de2-f145-457b-b76e-393073e149bb on hv-cinder-77819 Nov 25 08:43:58.002114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-d10eb887-6253-4699-b6af-66a8278339cf req-70964065-a6d1-40da-a673-c297f117ee1b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034811 Nov 25 08:43:58.002742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 329/641] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:43:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:43:58.004350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:58.009081 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:58.010290 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:58.017084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.018567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.019417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.020769 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.024764 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:58.030089 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:58.031480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8c7ee69d-17d2-4ec5-bd17-d6f0e4e54fa8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.625682 Nov 25 08:43:58.038710 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 313/642] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:57 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:58.183247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] HTTP exception thrown: Cannot 'detach_volume' instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 while it is in vm_state rescued Nov 25 08:43:58.184350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Returning 409 to user: Cannot 'detach_volume' instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 while it is in vm_state rescued {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:43:58.185962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7d7cf98e-346e-42c7-a996-30c79c5c1ffa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments/cddaa442-e9cc-4c20-8e69-67585f335673" status: 409 len: 152 microversion: 2.1 time: 0.181592 Nov 25 08:43:58.187385 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 330/643] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:43:58 2021] DELETE /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments/cddaa442-e9cc-4c20-8e69-67585f335673 => generated 152 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 25 08:43:58.202080 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-72353913-a9b4-4f4f-8db7-c5ed6c075878 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:43:58.203046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-72353913-a9b4-4f4f-8db7-c5ed6c075878 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:58.216012 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72353913-a9b4-4f4f-8db7-c5ed6c075878 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.216819 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72353913-a9b4-4f4f-8db7-c5ed6c075878 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.217948 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72353913-a9b4-4f4f-8db7-c5ed6c075878 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.218690 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-72353913-a9b4-4f4f-8db7-c5ed6c075878 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.356392 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-72353913-a9b4-4f4f-8db7-c5ed6c075878 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action" status: 202 len: 0 microversion: 2.1 time: 0.160326 Nov 25 08:43:58.359614 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 314/644] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:43:58 2021] POST /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:43:58.370484 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:58.372288 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:58.383182 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.384130 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.385751 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.386450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.442612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:58.444053 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:58.458217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.458570 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.459400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.459860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.496090 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.496527 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.496980 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lazy-loading 'fault' on Instance uuid 05f3bf22-bb61-4897-986f-99ae94f9fb33 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:43:58.564479 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c150bf72536c4fc3bb247e9cbb9e1b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412713b28e44d47abca28c866ca338e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:58.573704 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c62ab4a0-6626-4148-a739-afc51cf6948b tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 200 len: 1307 microversion: 2.1 time: 0.140250 Nov 25 08:43:58.574610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 315/645] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:58 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:58.589332 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:58.589883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:58.599611 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.600078 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.600899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:58.601333 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:58.805168 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:58.820879 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0efdc18b-6dd3-4d32-9243-ebcef9a2be1e tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1557 microversion: 2.1 time: 0.457788 Nov 25 08:43:58.821700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 331/646] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:58 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1557 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:59.045141 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:59.058924 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a45cc447-50a7-40d4-a3e9-2ed8fc4a5bde tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.472932 Nov 25 08:43:59.059932 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 316/647] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:58 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:43:59.061639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:59.062615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:59.070677 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.071372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:59.072329 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.072867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:59.415514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:59.417129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:59.429056 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.429589 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:59.431020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.431876 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:59.495046 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:59.517844 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:59.522221 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:43:59.524921 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d58e5f21-06e8-47fd-a5d2-a983b5d17b16 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.469701 Nov 25 08:43:59.526143 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 332/648] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:43:59 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:43:59.581424 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lazy-loading 'services' on Instance uuid d1aedc08-397b-4391-8040-58633cd7f2b0 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:43:59.596698 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:59.597615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] [instance: 05f3bf22-bb61-4897-986f-99ae94f9fb33] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:59.622472 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.623373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:59.626729 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.627636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:59.664809 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] HTTP exception thrown: Instance 05f3bf22-bb61-4897-986f-99ae94f9fb33 could not be found. Nov 25 08:43:59.666192 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] Returning 404 to user: Instance 05f3bf22-bb61-4897-986f-99ae94f9fb33 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:43:59.667375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3d160eec-3c09-41a0-9cb2-df5506c2a5cf tempest-AttachVolumeNegativeTest-1403245859 tempest-AttachVolumeNegativeTest-1403245859-project] 10.222.0.46 "GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33" status: 404 len: 111 microversion: 2.1 time: 0.078090 Nov 25 08:43:59.668514 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 333/649] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:59 2021] GET /compute/v2.1/servers/05f3bf22-bb61-4897-986f-99ae94f9fb33 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:43:59.734571 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b9191b92-64df-47f4-8211-1a8fdae8cbb1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-volume_attachments/eceeb480-8d83-4383-bf5d-0e570ff7208d" status: 202 len: 0 microversion: 2.1 time: 0.324597 Nov 25 08:43:59.740043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 317/650] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:43:59 2021] DELETE /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-volume_attachments/eceeb480-8d83-4383-bf5d-0e570ff7208d => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:43:59.860037 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:43:59.862917 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:43:59.881400 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.882563 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:43:59.886396 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:43:59.888676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:00.031360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-19f5a9d0-2d5e-4575-a337-60e9c9cd4dd3 req-cff72bef-85a0-477c-b2ec-17784e58033c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f3bf22-bb61-4897-986f-99ae94f9fb33", "name": "network-vif-deleted", "tag": "8705540a-ee14-46e8-9a43-02522efbdeb0"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:00.034663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:00.034663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:00.052595 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-19f5a9d0-2d5e-4575-a337-60e9c9cd4dd3 req-cff72bef-85a0-477c-b2ec-17784e58033c service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:00.054647 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-19f5a9d0-2d5e-4575-a337-60e9c9cd4dd3 req-cff72bef-85a0-477c-b2ec-17784e58033c service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:00.079062 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-19f5a9d0-2d5e-4575-a337-60e9c9cd4dd3 req-cff72bef-85a0-477c-b2ec-17784e58033c service nova] Creating event network-vif-deleted:8705540a-ee14-46e8-9a43-02522efbdeb0 for instance 05f3bf22-bb61-4897-986f-99ae94f9fb33 on hv-cinder-77819 Nov 25 08:44:00.089680 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-19f5a9d0-2d5e-4575-a337-60e9c9cd4dd3 req-cff72bef-85a0-477c-b2ec-17784e58033c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065926 Nov 25 08:44:00.090994 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 318/651] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:00.101370 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:00.102653 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:00.114445 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:00.115235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:00.116747 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:00.117526 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:00.251428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:00.279927 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fd235e0e-df11-49be-83a8-6969f9e9f8a0 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1557 microversion: 2.1 time: 0.426981 Nov 25 08:44:00.281611 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 334/652] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:43:59 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1557 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:00.362894 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:00.372834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-35704b5a-dbad-4bdf-903e-e00e4fb46f3d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.279482 Nov 25 08:44:00.373662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 319/653] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:00 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:00.546908 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:00.548084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:00.565602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:00.566113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:00.567758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:00.568195 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:00.770496 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:00.783201 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:00.786056 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:00.788530 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f4d1d42a-c960-4ea7-b103-ecda5c646673 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.246152 Nov 25 08:44:00.790210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 335/654] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:00 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:44:00.935485 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b3e33083-4748-419e-991c-9aa8eb5b2c17 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:00.944580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3e33083-4748-419e-991c-9aa8eb5b2c17 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:00.945317 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3e33083-4748-419e-991c-9aa8eb5b2c17 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.017386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b3e33083-4748-419e-991c-9aa8eb5b2c17 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Going to try to stop instance {{(pid=122643) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 25 08:44:01.075307 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b3e33083-4748-419e-991c-9aa8eb5b2c17 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 202 len: 0 microversion: 2.1 time: 0.144082 Nov 25 08:44:01.080360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 320/655] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:44:00 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:44:01.104719 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:01.105532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:01.119641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.120463 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.127856 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.128548 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.315152 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:01.319490 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:01.334147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.334987 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.336726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.338039 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.360682 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:01.374528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f1f22c41-241d-4c80-9711-d9b61994baa1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.291965 Nov 25 08:44:01.382437 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 336/656] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:01 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:01.395830 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:01.396734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:01.408737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.409435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.411307 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.412114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.683747 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:01.726261 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-849ec2d7-d014-47bd-9871-437683b6ce7d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1557 microversion: 2.1 time: 0.419646 Nov 25 08:44:01.728108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 321/657] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:01 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1557 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:01.737489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-2670ba43-0efe-4167-bd72-4124edb44f24 req-e92b4008-1d54-468d-aeee-9c1bde3d2bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e5c47-a03f-44f8-8181-954812e9b38b", "name": "network-vif-plugged", "status": "completed", "tag": "e813642c-c46b-4870-94db-1582911a9fad"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:01.741579 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:01.741579 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:01.765025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-2670ba43-0efe-4167-bd72-4124edb44f24 req-e92b4008-1d54-468d-aeee-9c1bde3d2bbf service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.768157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-2670ba43-0efe-4167-bd72-4124edb44f24 req-e92b4008-1d54-468d-aeee-9c1bde3d2bbf service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.802282 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-2670ba43-0efe-4167-bd72-4124edb44f24 req-e92b4008-1d54-468d-aeee-9c1bde3d2bbf service nova] Creating event network-vif-plugged:e813642c-c46b-4870-94db-1582911a9fad for instance 861e5c47-a03f-44f8-8181-954812e9b38b on hv-cinder-77819 Nov 25 08:44:01.815087 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-2670ba43-0efe-4167-bd72-4124edb44f24 req-e92b4008-1d54-468d-aeee-9c1bde3d2bbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084294 Nov 25 08:44:01.816892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 322/658] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:01.824840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:01.835612 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6a1d0f8c-86c8-48b7-8e1e-d69d0fadedf2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.445720 Nov 25 08:44:01.842136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 337/659] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:01 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:01.842795 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:01.845574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:01.862665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.863531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:01.865388 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:01.866393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:02.051480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:02.063164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:02.063771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:02.065149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d9936101-9c13-4be3-8e64-aa73b25e2391 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.246366 Nov 25 08:44:02.069601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 323/660] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:01 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:44:02.406116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:02.408252 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:02.415409 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:02.416204 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:02.417227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:02.417834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:02.603498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:02.618006 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-30696df2-865e-4c53-8464-2cef6c9f120f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.215499 Nov 25 08:44:02.618742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 338/661] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:02 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:02.758528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:02.759161 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:02.765321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:02.765855 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:02.766718 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:02.767215 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:02.858070 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:02.859005 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:02.872775 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:02.873512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:02.874517 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:02.875001 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.004777 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:03.020536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2314bbc9-1085-4b58-8295-b2ad8ab5dd6b tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1563 microversion: 2.1 time: 0.266659 Nov 25 08:44:03.021646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 324/662] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:02 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:03.104341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:03.104341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:03.110805 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.111456 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.112454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.113025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.155184 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:03.171190 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-93398c16-1f43-4d7e-a7e2-e29c210529b1 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.319665 Nov 25 08:44:03.172965 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 339/663] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:02 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:03.182826 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:03.184155 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:03.194947 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.195775 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.197232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.198009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.356052 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lazy-loading 'services' on Instance uuid a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:44:03.457459 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e76b0980-36b3-4d8e-a431-7884d892c83a tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments/cddaa442-e9cc-4c20-8e69-67585f335673" status: 202 len: 0 microversion: 2.1 time: 0.281806 Nov 25 08:44:03.459404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 340/664] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:44:03 2021] DELETE /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments/cddaa442-e9cc-4c20-8e69-67585f335673 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:44:03.486104 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-569aa497-bb60-42c6-a421-597629d0903d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:03.487948 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-569aa497-bb60-42c6-a421-597629d0903d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:03.503513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-569aa497-bb60-42c6-a421-597629d0903d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.505184 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-569aa497-bb60-42c6-a421-597629d0903d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.507125 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-569aa497-bb60-42c6-a421-597629d0903d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.507936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-569aa497-bb60-42c6-a421-597629d0903d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.564065 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-569aa497-bb60-42c6-a421-597629d0903d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086089 Nov 25 08:44:03.565306 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 341/665] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:44:03 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:03.639500 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:03.640567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:03.654004 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.654847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.658276 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.659072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.765514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:03.795640 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:03.803354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:03.807499 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4cd6b809-feca-426e-a3a5-674219e96c25 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.715381 Nov 25 08:44:03.829738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 325/666] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:03 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:44:03.862112 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-b23765b8-d46a-4b00-9f82-e369af1d0386 req-1b3ec002-2297-4d42-a33b-5fb3440be68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a68de2-f145-457b-b76e-393073e149bb", "name": "network-vif-plugged", "status": "completed", "tag": "8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:03.864754 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:03.864754 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:03.878164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-b23765b8-d46a-4b00-9f82-e369af1d0386 req-1b3ec002-2297-4d42-a33b-5fb3440be68a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:03.880850 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-b23765b8-d46a-4b00-9f82-e369af1d0386 req-1b3ec002-2297-4d42-a33b-5fb3440be68a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:03.902866 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-b23765b8-d46a-4b00-9f82-e369af1d0386 req-1b3ec002-2297-4d42-a33b-5fb3440be68a service nova] Creating event network-vif-plugged:8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d for instance 91a68de2-f145-457b-b76e-393073e149bb on hv-cinder-77819 Nov 25 08:44:03.908574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-b23765b8-d46a-4b00-9f82-e369af1d0386 req-1b3ec002-2297-4d42-a33b-5fb3440be68a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050899 Nov 25 08:44:03.909176 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 326/667] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:44:03.960655 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:03.979416 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9d6fe59c-4f40-45ef-9402-787734bdcf93 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.343388 Nov 25 08:44:03.980595 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 342/668] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:03 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:04.196551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:04.198475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:04.211689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:04.212628 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:04.214118 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:04.214984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:04.446929 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:04.459773 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2f21a463-7f87-49b3-83fe-f280c9961642 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.267885 Nov 25 08:44:04.459773 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 327/669] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:04 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:04.577429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ad01fbdf-728c-4297-940f-9acfc760985c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:04.583728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ad01fbdf-728c-4297-940f-9acfc760985c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:04.593362 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad01fbdf-728c-4297-940f-9acfc760985c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:04.593811 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad01fbdf-728c-4297-940f-9acfc760985c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:04.594881 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad01fbdf-728c-4297-940f-9acfc760985c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:04.595707 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad01fbdf-728c-4297-940f-9acfc760985c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:04.642212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ad01fbdf-728c-4297-940f-9acfc760985c tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068808 Nov 25 08:44:04.642794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 343/670] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:44:04 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:44:04.844831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:04.846296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:04.854849 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:04.855853 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:04.857551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:04.858314 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:05.012153 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:05.014286 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:05.030116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:05.031306 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:05.033508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:05.035641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:05.138287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:05.153925 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:05.155483 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:05.163297 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-53422b84-157d-4f54-aea3-6d938619413d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1811 microversion: 2.20 time: 0.320723 Nov 25 08:44:05.163971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 328/671] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:04 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1811 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:44:05.256084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:05.266842 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2b433b4f-f21a-48d3-ab53-90d4fb7dd7b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.262434 Nov 25 08:44:05.267443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 344/672] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:05 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:05.482919 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:05.483551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:05.491394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:05.491876 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:05.492681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:05.493448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:05.663597 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:05.676186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-aa4f6024-afe4-4009-a21e-3c3f5361cab0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1358 microversion: 2.1 time: 0.196080 Nov 25 08:44:05.677336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 329/673] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:05 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:06.101702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:44:06.102335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:44:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:44:06.189579 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:06.190753 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:06.200049 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.200410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:06.202191 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.202939 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:06.289251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:06.290066 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:06.296619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.297427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:06.298303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.298929 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:06.445646 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:06.458593 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:06.461585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:06.463448 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6c65bff2-45e0-4f30-bf1e-37c638a381c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1798 microversion: 2.20 time: 0.278695 Nov 25 08:44:06.464508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 345/674] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:06 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1798 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:44:06.550801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:06.565731 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3c5abc1d-25ab-4aa7-a8b9-d3813fcb263d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.281198 Nov 25 08:44:06.567457 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 330/675] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:06 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:06.694580 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:06.695190 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:06.702348 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.702799 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:06.703820 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.704303 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:06.893674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:06.907755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-43a1ef5b-0e1f-42a4-9dda-4b92b32464b2 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1549 microversion: 2.1 time: 0.216865 Nov 25 08:44:06.908734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 346/676] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:06 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:06.935442 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:06.936186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:06.943899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.944430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:06.945297 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:06.945810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.133671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:07.134416 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:07.145580 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.146305 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.147708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.148289 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:07.148450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.163768 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-aae0c340-2251-4432-8e8d-ef09fc65ff81 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1549 microversion: 2.1 time: 0.232268 Nov 25 08:44:07.164957 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 331/677] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:06 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1549 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:07.189114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:44:07.195530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:07.203512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:07.203512 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:07.205693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:07.207761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Searching by: {'deleted': False, 'project_id': '2dc4103c9eb443549b5e374c148eae92'} {{(pid=122643) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 25 08:44:07.220241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.221153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.223645 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.224585 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.307924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cbb82f87-2070-43f7-8ea5-9cd3ba3f077d tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "DELETE /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 204 len: 0 microversion: 2.1 time: 0.181404 Nov 25 08:44:07.309365 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 347/678] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:44:07 2021] DELETE /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:44:07.324991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:07.326766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:07.339324 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.340588 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.341924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.343205 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.411196 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.multi_cell_list [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 25 08:44:07.534232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:07.542466 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d0b13f86-d63b-422a-a4fb-da67607046fa tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1507 microversion: 2.1 time: 0.225155 Nov 25 08:44:07.543051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 348/679] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:07 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:07.595237 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-98d57c50-6fef-4bbb-ae97-708b9023c45e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.407255 Nov 25 08:44:07.596235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 332/680] 10.222.0.46 () {58 vars in 1124 bytes} [Thu Nov 25 08:44:07 2021] GET /compute/v2.1/servers => generated 342 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:44:07.605734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:07.606606 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:07.610801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:07.611792 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:07.615902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.616809 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.617718 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.618314 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.619876 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.620355 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.621307 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:07.621802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:07.850674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:07.865636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-770b39a4-02c2-42d8-954f-3e8a75954440 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.275696 Nov 25 08:44:07.866619 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 349/681] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:07 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:07.867619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:07.883145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b2623352-e9e4-4e3c-a83c-4c9e5eac238a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1549 microversion: 2.1 time: 0.277781 Nov 25 08:44:07.884605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 333/682] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:07 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1549 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:08.560897 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:08.561603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:08.569602 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:08.570046 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:08.570842 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:08.571282 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:08.724885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:08.732663 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-43731e7a-5206-4002-abb3-e3af8014d661 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1507 microversion: 2.1 time: 0.175719 Nov 25 08:44:08.733242 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 350/683] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:08 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:08.884643 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:08.885252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:08.892052 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:08.892498 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:08.893305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:08.893744 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:09.042485 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:09.050355 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-62eb243c-164a-4c2d-8048-043871637edf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.169308 Nov 25 08:44:09.051489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 334/684] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:08 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:09.499620 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-11df1859-ef25-4c36-97d1-1e60ea57073a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f346244b-8675-451e-9290-9643b6504838"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:09.501142 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-11df1859-ef25-4c36-97d1-1e60ea57073a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:09.508715 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11df1859-ef25-4c36-97d1-1e60ea57073a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:09.509163 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11df1859-ef25-4c36-97d1-1e60ea57073a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:09.510009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11df1859-ef25-4c36-97d1-1e60ea57073a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:09.510448 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11df1859-ef25-4c36-97d1-1e60ea57073a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:09.754325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:09.755635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:09.766409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:09.767427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:09.769386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:09.770911 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:09.835216 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-11df1859-ef25-4c36-97d1-1e60ea57073a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339961 Nov 25 08:44:09.835875 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 351/685] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:44:09 2021] POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:10.071186 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:10.072101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:10.072892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:10.080757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-80a3b6b1-45ef-4dc5-a4e4-aeb12b12a329 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1507 microversion: 2.1 time: 0.332710 Nov 25 08:44:10.080978 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:10.081398 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:10.083108 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:10.083636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:10.093200 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 335/686] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:09 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:10.358728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:10.375916 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cf4da10b-6133-4784-8b92-aa9acf56be3e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1675 microversion: 2.1 time: 0.310167 Nov 25 08:44:10.377970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 352/687] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:10 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1675 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:10.577251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-65c68e98-1b32-49db-9568-030c0512b60c req-75adb787-3a57-414c-ac3a-ef87c2c6baae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ffb424-199d-477b-a9f0-afc0246d1fba", "name": "network-vif-deleted", "tag": "427dce62-22d3-4c59-9af7-e194abc69928"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:10.579179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:10.579179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:10.589664 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-65c68e98-1b32-49db-9568-030c0512b60c req-75adb787-3a57-414c-ac3a-ef87c2c6baae service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:10.590427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-65c68e98-1b32-49db-9568-030c0512b60c req-75adb787-3a57-414c-ac3a-ef87c2c6baae service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:10.603003 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-65c68e98-1b32-49db-9568-030c0512b60c req-75adb787-3a57-414c-ac3a-ef87c2c6baae service nova] Creating event network-vif-deleted:427dce62-22d3-4c59-9af7-e194abc69928 for instance 69ffb424-199d-477b-a9f0-afc0246d1fba on hv-cinder-77819 Nov 25 08:44:10.610447 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-65c68e98-1b32-49db-9568-030c0512b60c req-75adb787-3a57-414c-ac3a-ef87c2c6baae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038039 Nov 25 08:44:10.611760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 336/688] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:11.108559 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:11.109524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:11.121812 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.122517 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:11.124029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.124813 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:11.169905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.170370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:11.171014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lazy-loading 'fault' on Instance uuid 69ffb424-199d-477b-a9f0-afc0246d1fba {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:44:11.243176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:11.251326 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-306b7a85-f6c1-4714-8e00-7e1ec2ac37e8 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 200 len: 1311 microversion: 2.1 time: 0.154160 Nov 25 08:44:11.252017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 353/689] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:11 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:11.407832 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:11.408659 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:11.417782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.418528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:11.420389 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.420788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:11.634458 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:11.648250 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bde32d0f-8523-4b34-91de-1c891ad408cc tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1652 microversion: 2.1 time: 0.245885 Nov 25 08:44:11.649353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 337/690] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:11 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1652 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:11.668978 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-467c949f-c038-473c-b5ce-a893e0abf6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:11.677268 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-467c949f-c038-473c-b5ce-a893e0abf6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.677869 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-467c949f-c038-473c-b5ce-a893e0abf6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:11.704526 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-467c949f-c038-473c-b5ce-a893e0abf6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Going to try to start instance {{(pid=122641) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 25 08:44:11.764542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-467c949f-c038-473c-b5ce-a893e0abf6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action" status: 202 len: 0 microversion: 2.1 time: 0.099014 Nov 25 08:44:11.765633 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 354/691] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:44:11 2021] POST /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:44:11.780333 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:11.781880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:11.794255 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.795610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:11.797150 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:11.797892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:12.117164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:12.130123 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-edc9692e-0d76-40d5-9db5-6570abd02ac2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1661 microversion: 2.1 time: 0.355806 Nov 25 08:44:12.131115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 338/692] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:11 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1661 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:12.276793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:12.277814 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: 69ffb424-199d-477b-a9f0-afc0246d1fba] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:12.286748 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:12.287449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:12.288413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:12.288922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:12.305840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] HTTP exception thrown: Instance 69ffb424-199d-477b-a9f0-afc0246d1fba could not be found. Nov 25 08:44:12.306436 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Returning 404 to user: Instance 69ffb424-199d-477b-a9f0-afc0246d1fba could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:44:12.307269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fc1c34a1-3f30-4572-895b-266ea88ee5e5 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba" status: 404 len: 111 microversion: 2.1 time: 0.035994 Nov 25 08:44:12.307968 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 355/693] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:12 2021] GET /compute/v2.1/servers/69ffb424-199d-477b-a9f0-afc0246d1fba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:44:12.319355 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:12.320078 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:12.327251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:12.327881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:12.328772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:12.329288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:12.359986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Going to try to terminate instance {{(pid=122643) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:44:12.457539 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-eae69d28-f9e9-49fa-a25d-98b5fe73a5ce tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 204 len: 0 microversion: 2.1 time: 0.142707 Nov 25 08:44:12.459226 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 339/694] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:44:12 2021] DELETE /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:44:12.469157 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:12.469861 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:12.483082 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:12.483692 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:12.484658 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:12.485281 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:12.830818 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:12.839523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-90e64812-9362-43ec-a9db-e6f8083820b6 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.375675 Nov 25 08:44:12.840287 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 356/695] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:12 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:13.157886 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:13.159274 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:13.169930 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:13.170701 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:13.171851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:13.172909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:13.411306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:13.425173 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a0b3b45a-ca45-48f3-9113-156d6189e1b7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1661 microversion: 2.1 time: 0.273331 Nov 25 08:44:13.426984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 340/696] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:13 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1661 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:13.860013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:13.861032 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:13.870016 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:13.870757 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:13.872019 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:13.872874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:14.109505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:14.123786 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-41e4454e-5ac7-4b1e-9b79-ab040c5a314f tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.268245 Nov 25 08:44:14.124897 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 357/697] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:13 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:14.453341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:14.454227 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:14.461981 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:14.462787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:14.463770 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:14.464540 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:14.734888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:14.744714 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f3ace567-7503-42e1-b6e2-9c5bfa0f122b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1665 microversion: 2.1 time: 0.295753 Nov 25 08:44:14.745427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 341/698] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:14 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1665 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:15.151371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:15.152412 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:15.163998 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:15.165199 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:15.166322 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:15.167300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:15.407014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:15.420057 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-32e6c4c9-e9b9-4fda-a1e2-a38f19380ed4 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.274245 Nov 25 08:44:15.420707 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 358/699] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:15 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:16.445841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:16.446900 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:16.463350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:16.464536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:16.467242 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:16.468286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:16.703661 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:16.713423 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f3775e2b-3aaa-42d0-9b92-f0166c1ccd63 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.275341 Nov 25 08:44:16.714508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 342/700] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:16 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:17.719906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:17.720573 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:17.729838 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:17.731711 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:17.733185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:17.734056 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:17.737489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:17.738458 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:17.750616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:17.751257 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:17.752700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:17.754148 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:18.107887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:18.117151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:18.121454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8bf89904-cbbf-4b5d-8b9d-c3ebcc1d88af tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1523 microversion: 2.1 time: 0.391419 Nov 25 08:44:18.122681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 343/701] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:17 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:18.129581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-941fb96f-ebb1-4061-ae2e-fbffd3b21bdf tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1595 microversion: 2.1 time: 0.413501 Nov 25 08:44:18.130421 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 359/702] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:17 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1595 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:19.152188 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:19.154448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:19.166580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:19.167403 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:19.168868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:19.169678 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:19.352115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f1f1fa8189f49048547c3f9205a1637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85d133bd71746088b6aa4cb9b1cb117', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:19.367389 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cdafc8ca-dd86-4995-a50a-13fa53d52559 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 200 len: 1481 microversion: 2.1 time: 0.222297 Nov 25 08:44:19.370536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 344/703] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:19 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 1481 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:19.466527 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-f73bb5d9-947c-45fa-ab34-aa0038b83032 req-4a8a911e-2af9-4225-a969-70f74cffc1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398", "name": "network-vif-deleted", "tag": "7d1f8ee3-49ee-4f81-b4cc-fb76fcde1998"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:19.472195 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:19.472195 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:44:19.492287 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-f73bb5d9-947c-45fa-ab34-aa0038b83032 req-4a8a911e-2af9-4225-a969-70f74cffc1ca service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:19.493118 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-f73bb5d9-947c-45fa-ab34-aa0038b83032 req-4a8a911e-2af9-4225-a969-70f74cffc1ca service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:19.519320 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-f73bb5d9-947c-45fa-ab34-aa0038b83032 req-4a8a911e-2af9-4225-a969-70f74cffc1ca service nova] Creating event network-vif-deleted:7d1f8ee3-49ee-4f81-b4cc-fb76fcde1998 for instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 on hv-cinder-77819 Nov 25 08:44:19.529100 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-f73bb5d9-947c-45fa-ab34-aa0038b83032 req-4a8a911e-2af9-4225-a969-70f74cffc1ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075078 Nov 25 08:44:19.530673 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 360/704] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:20.397501 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:20.398752 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] [instance: a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:20.407303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:20.408071 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:20.409573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:20.410203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:20.432939 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] HTTP exception thrown: Instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 could not be found. Nov 25 08:44:20.433864 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] Returning 404 to user: Instance a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:44:20.436468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f81e8c55-148a-4de1-a968-e0d1c6da9511 tempest-ServerRescueNegativeTestJSON-1978806149 tempest-ServerRescueNegativeTestJSON-1978806149-project] 10.222.0.46 "GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398" status: 404 len: 111 microversion: 2.1 time: 0.043365 Nov 25 08:44:20.437661 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 345/705] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:20 2021] GET /compute/v2.1/servers/a3b4bd1a-ba00-4e10-8b4d-0f0a963fc398 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:44:21.226440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-b8dbf2c0-863a-4d24-b392-d46d04c12bf9 req-f9e43135-67b1-42a9-b1f5-6b11d8c79166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a68de2-f145-457b-b76e-393073e149bb", "tag": "8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:21.231144 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:21.231144 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:44:21.266618 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-b8dbf2c0-863a-4d24-b392-d46d04c12bf9 req-f9e43135-67b1-42a9-b1f5-6b11d8c79166 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:21.267380 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-b8dbf2c0-863a-4d24-b392-d46d04c12bf9 req-f9e43135-67b1-42a9-b1f5-6b11d8c79166 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:21.325124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-b8dbf2c0-863a-4d24-b392-d46d04c12bf9 req-f9e43135-67b1-42a9-b1f5-6b11d8c79166 service nova] Creating event network-changed:8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d for instance 91a68de2-f145-457b-b76e-393073e149bb on hv-cinder-77819 Nov 25 08:44:21.349731 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-b8dbf2c0-863a-4d24-b392-d46d04c12bf9 req-f9e43135-67b1-42a9-b1f5-6b11d8c79166 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129604 Nov 25 08:44:21.357545 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 361/706] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:23.233504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-790265520"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:23.234620 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:23.245009 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:23.245912 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:23.247036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:23.247670 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:23.683871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.network.security_group_api [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Adding security group 478f8223-2855-4c55-b909-5d1ac5de451b to port 8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d Nov 25 08:44:24.648081 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-144ee704-98d4-41e7-9d0e-b0168f6dc5e8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/action" status: 202 len: 0 microversion: 2.1 time: 1.418696 Nov 25 08:44:24.656147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 346/707] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:44:23 2021] POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/action => generated 0 bytes in 1429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:44:24.668459 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-bfed82b6-1110-4808-8eaf-abe542d13e73 req-797641f1-5d23-4fe4-ae3d-6ab1bd1eaff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a68de2-f145-457b-b76e-393073e149bb", "tag": "8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:24.674119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:24.674119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:24.693479 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:24.696742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-bfed82b6-1110-4808-8eaf-abe542d13e73 req-797641f1-5d23-4fe4-ae3d-6ab1bd1eaff0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:24.697235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-bfed82b6-1110-4808-8eaf-abe542d13e73 req-797641f1-5d23-4fe4-ae3d-6ab1bd1eaff0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:24.699182 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:24.720455 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-bfed82b6-1110-4808-8eaf-abe542d13e73 req-797641f1-5d23-4fe4-ae3d-6ab1bd1eaff0 service nova] Creating event network-changed:8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d for instance 91a68de2-f145-457b-b76e-393073e149bb on hv-cinder-77819 Nov 25 08:44:24.729575 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:24.731656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-bfed82b6-1110-4808-8eaf-abe542d13e73 req-797641f1-5d23-4fe4-ae3d-6ab1bd1eaff0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066755 Nov 25 08:44:24.736577 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 347/708] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:24.738314 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:24.739696 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:24.740311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:25.278406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:25.294697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-da1522bf-ffd1-4857-b4fd-184931f9ec6b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1760 microversion: 2.1 time: 0.631107 Nov 25 08:44:25.296020 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 362/709] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:24 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1760 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:46.648441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dfa35ea3-caf1-4691-9cd8-9de724b1a7eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:46.649321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dfa35ea3-caf1-4691-9cd8-9de724b1a7eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:46.656329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dfa35ea3-caf1-4691-9cd8-9de724b1a7eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:46.656917 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dfa35ea3-caf1-4691-9cd8-9de724b1a7eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:46.657806 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dfa35ea3-caf1-4691-9cd8-9de724b1a7eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:46.658281 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dfa35ea3-caf1-4691-9cd8-9de724b1a7eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:46.695366 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dfa35ea3-caf1-4691-9cd8-9de724b1a7eb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments/163a40bd-6dc1-4bf3-9008-2e9a2727f379" status: 200 len: 194 microversion: 2.20 time: 0.053236 Nov 25 08:44:46.696111 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 348/710] 10.222.0.46 () {60 vars in 1453 bytes} [Thu Nov 25 08:44:46 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments/163a40bd-6dc1-4bf3-9008-2e9a2727f379 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:44:46.778480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:46.779395 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:46.793104 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:46.794433 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:46.796050 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:46.797213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:46.974149 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lazy-loading 'services' on Instance uuid 861e5c47-a03f-44f8-8181-954812e9b38b {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:44:47.100680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a1778108-3d85-43b9-a951-5b1e9cb75485 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments/163a40bd-6dc1-4bf3-9008-2e9a2727f379" status: 202 len: 0 microversion: 2.20 time: 0.328579 Nov 25 08:44:47.108299 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 363/711] 10.222.0.46 () {60 vars in 1456 bytes} [Thu Nov 25 08:44:46 2021] DELETE /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments/163a40bd-6dc1-4bf3-9008-2e9a2727f379 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 25 08:44:47.117428 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7b1fa0b3-3dd1-4414-b129-d911caf7f3fe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:47.119490 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7b1fa0b3-3dd1-4414-b129-d911caf7f3fe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:47.131841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1fa0b3-3dd1-4414-b129-d911caf7f3fe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:47.133093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1fa0b3-3dd1-4414-b129-d911caf7f3fe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:47.134805 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1fa0b3-3dd1-4414-b129-d911caf7f3fe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:47.135908 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1fa0b3-3dd1-4414-b129-d911caf7f3fe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:47.201766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7b1fa0b3-3dd1-4414-b129-d911caf7f3fe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091463 Nov 25 08:44:47.203832 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 349/712] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Nov 25 08:44:47 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:44:48.218519 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-eae779b7-7b6b-4ef7-b480-82b52712c2d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:48.219585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-eae779b7-7b6b-4ef7-b480-82b52712c2d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:48.227243 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eae779b7-7b6b-4ef7-b480-82b52712c2d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:48.227716 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eae779b7-7b6b-4ef7-b480-82b52712c2d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:48.228498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eae779b7-7b6b-4ef7-b480-82b52712c2d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:48.228989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eae779b7-7b6b-4ef7-b480-82b52712c2d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:48.261216 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-eae779b7-7b6b-4ef7-b480-82b52712c2d2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048100 Nov 25 08:44:48.262043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 364/713] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Nov 25 08:44:48 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:44:48.785158 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1361233033", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "9d63ce6f-4cd1-4d31-b308-a6ca97fe31c4"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:48.843719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] validate_networks() for [('9d63ce6f-4cd1-4d31-b308-a6ca97fe31c4', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:44:49.276912 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-07dd5092-4ddd-4137-b180-0c5b8b13aeb0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:49.280137 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-07dd5092-4ddd-4137-b180-0c5b8b13aeb0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:49.293807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-07dd5092-4ddd-4137-b180-0c5b8b13aeb0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.294977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-07dd5092-4ddd-4137-b180-0c5b8b13aeb0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.296432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-07dd5092-4ddd-4137-b180-0c5b8b13aeb0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.297420 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-07dd5092-4ddd-4137-b180-0c5b8b13aeb0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.311582 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:44:49.312111 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:44:49.312579 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:44:49.312986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:44:49.313394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:44:49.326108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.326569 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.327780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.328259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.339417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-07dd5092-4ddd-4137-b180-0c5b8b13aeb0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069092 Nov 25 08:44:49.340046 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 365/714] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Nov 25 08:44:49 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:49.348831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Getting quotas for project b12215da390b49b9ba3f302c6a19a80a. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:44:49.353412 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Getting quotas for user 63b4fe6fb539453681ca6870f6997ad8 and project b12215da390b49b9ba3f302c6a19a80a. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:44:49.366669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:44:49.369347 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:44:49.413772 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:49.414374 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:49.418184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8ebf4781-1b85-4382-b03b-9b5b1004668b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637108 Nov 25 08:44:49.418864 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 350/715] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:44:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:44:49.425743 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.427994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.429287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5bf6b33b-ba1d-4aff-ac1b-f8e9fc86fb72 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:49.429904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5bf6b33b-ba1d-4aff-ac1b-f8e9fc86fb72 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:49.430166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.430977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.478674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:44:49.497030 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5bf6b33b-ba1d-4aff-ac1b-f8e9fc86fb72 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:49.511013 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5bf6b33b-ba1d-4aff-ac1b-f8e9fc86fb72 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1214 microversion: 2.1 time: 0.084932 Nov 25 08:44:49.512724 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 351/716] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:49 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:49.576490 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5bb6141e-bdba-4893-a543-31b41f8f8b1f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 204 len: 0 microversion: 2.20 time: 0.166822 Nov 25 08:44:49.577311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 366/717] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Nov 25 08:44:49 2021] DELETE /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 25 08:44:49.587867 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:49.588609 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:49.597073 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.597966 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.599731 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:49.600711 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:49.807632 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:49.831378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:49.834660 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:49.836893 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e7bc42fe-c432-412e-9fc5-a83d6ef8fb12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.253204 Nov 25 08:44:49.837934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 352/718] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:49 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:44:50.544045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:50.545124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:50.558674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:50.559627 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:50.561340 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:50.562482 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:50.691966 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:50.703174 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fc811a94-1c09-4f79-9f2e-cfbab351e0b6 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1274 microversion: 2.1 time: 0.166573 Nov 25 08:44:50.704996 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 367/719] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:50 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:50.858419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:50.859235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:50.873774 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:50.874493 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:50.876846 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:50.878271 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:51.126954 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:51.143882 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:51.147202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:51.149528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-64c4a357-5335-4285-a52c-182436fec321 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.294757 Nov 25 08:44:51.150560 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 353/720] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:50 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:44:51.736556 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:51.737932 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:51.749131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:51.750021 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:51.752515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:51.753438 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:52.180802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:52.182385 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:52.192073 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:52.192802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:52.193823 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:52.194426 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:52.386063 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:52.398940 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7f07e3ee-1f42-4e31-85ad-c5dad127713e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.670939 Nov 25 08:44:52.400038 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 368/721] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:51 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:52.914295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:52.927180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:52.930302 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:52.931978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d32e1a0b-4284-4b13-bc35-60de6dafa5ef tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1726 microversion: 2.20 time: 0.756398 Nov 25 08:44:52.932555 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 354/722] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:52 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1726 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:44:53.422033 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:53.422830 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:53.431298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:53.432063 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:53.433737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:53.434577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:53.546852 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-7d0e39b9-1a7b-461c-862f-4da9e6454e4a req-72f6b93a-7267-4127-bf46-a237e1941901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "054fbbf2-1e0b-4c8c-a440-1543622a65bd", "tag": "cb7bbad4-ef68-4a03-b97c-cdd848a53467"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:53.550524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:53.550524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:53.559494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-7d0e39b9-1a7b-461c-862f-4da9e6454e4a req-72f6b93a-7267-4127-bf46-a237e1941901 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:53.560254 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-7d0e39b9-1a7b-461c-862f-4da9e6454e4a req-72f6b93a-7267-4127-bf46-a237e1941901 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:53.574430 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-7d0e39b9-1a7b-461c-862f-4da9e6454e4a req-72f6b93a-7267-4127-bf46-a237e1941901 service nova] Creating event network-changed:cb7bbad4-ef68-4a03-b97c-cdd848a53467 for instance 054fbbf2-1e0b-4c8c-a440-1543622a65bd on hv-cinder-77819 Nov 25 08:44:53.583590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-7d0e39b9-1a7b-461c-862f-4da9e6454e4a req-72f6b93a-7267-4127-bf46-a237e1941901 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040042 Nov 25 08:44:53.584507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 355/723] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:44:53.855288 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:53.869059 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0153abb5-ff53-45bb-83fd-2409b2919cda tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.450707 Nov 25 08:44:53.872311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 369/724] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:53 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:53.955323 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:53.956405 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:53.966762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:53.967432 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:53.968681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:53.969282 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:54.036016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:54.036980 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:54.038023 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lazy-loading 'fault' on Instance uuid 861e5c47-a03f-44f8-8181-954812e9b38b {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:44:54.112831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:54.132099 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:54.136189 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:54.138950 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-76ca0fbf-3c11-4a39-85fe-54d1525ca57c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 200 len: 1372 microversion: 2.20 time: 0.189169 Nov 25 08:44:54.140053 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 356/725] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:53 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:44:54.473969 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8594c31a-6125-4951-be80-98ec8ac06eea tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:54.475652 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8594c31a-6125-4951-be80-98ec8ac06eea tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:54.508724 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8594c31a-6125-4951-be80-98ec8ac06eea tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:54.510351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8594c31a-6125-4951-be80-98ec8ac06eea tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:54.512315 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8594c31a-6125-4951-be80-98ec8ac06eea tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:54.513375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8594c31a-6125-4951-be80-98ec8ac06eea tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:54.666377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8594c31a-6125-4951-be80-98ec8ac06eea tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/action" status: 202 len: 0 microversion: 2.1 time: 0.199827 Nov 25 08:44:54.667679 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 370/726] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:44:54 2021] POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:44:54.682839 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:54.685413 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:54.699455 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:54.702693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:54.704641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:54.708360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:54.898060 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:54.909536 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:54.925384 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:54.926417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:54.928358 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:54.929926 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:55.424552 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:55.439383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ed09b058-3b3a-4310-a303-d341e7768a65 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1752 microversion: 2.1 time: 0.764412 Nov 25 08:44:55.441111 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 357/727] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:54 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1752 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:55.448172 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:55.449381 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:55.450764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:55.457914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:55.458702 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:55.460188 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:55.461190 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:55.468442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ac17b5e2-c9f2-48c2-b830-d69de7d6d315 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.580865 Nov 25 08:44:55.469094 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 371/728] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:54 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:55.486058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] HTTP exception thrown: Instance 861e5c47-a03f-44f8-8181-954812e9b38b could not be found. Nov 25 08:44:55.486840 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Returning 404 to user: Instance 861e5c47-a03f-44f8-8181-954812e9b38b could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:44:55.487754 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-50115bd1-5313-4359-a05a-d5194d98a37b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 404 len: 111 microversion: 2.20 time: 0.045251 Nov 25 08:44:55.488335 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 358/729] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:55 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 25 08:44:55.500180 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4d1b2aba-9317-4561-a70c-a72a74c4f095 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '.version_select at 0x7f9708664820>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:55.535272 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4d1b2aba-9317-4561-a70c-a72a74c4f095 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286633930" status: 204 len: 0 microversion: 2.20 time: 0.039246 Nov 25 08:44:55.536309 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 372/730] 10.222.0.46 () {60 vars in 1261 bytes} [Thu Nov 25 08:44:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1286633930 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 25 08:44:55.663955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-6ace0347-0796-486f-b90b-2ef2884110a4 req-3065d1b2-00be-4a37-8476-392ade40488a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861e5c47-a03f-44f8-8181-954812e9b38b", "name": "network-vif-deleted", "tag": "e813642c-c46b-4870-94db-1582911a9fad"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:55.665878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:44:55.665878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:44:55.673953 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-6ace0347-0796-486f-b90b-2ef2884110a4 req-3065d1b2-00be-4a37-8476-392ade40488a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:55.674697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-6ace0347-0796-486f-b90b-2ef2884110a4 req-3065d1b2-00be-4a37-8476-392ade40488a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:55.687237 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-6ace0347-0796-486f-b90b-2ef2884110a4 req-3065d1b2-00be-4a37-8476-392ade40488a service nova] Creating event network-vif-deleted:e813642c-c46b-4870-94db-1582911a9fad for instance 861e5c47-a03f-44f8-8181-954812e9b38b on hv-cinder-77819 Nov 25 08:44:55.693154 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-6ace0347-0796-486f-b90b-2ef2884110a4 req-3065d1b2-00be-4a37-8476-392ade40488a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 Nov 25 08:44:55.693957 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 359/731] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:44:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:44:56.472592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:56.473785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:56.484015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:56.485072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:56.489018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:56.489018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:56.502454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:56.504107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:56.515277 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:56.516122 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:56.518099 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:56.519207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:57.135090 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:57.153023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:57.154231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0d478c97-81f0-4692-87d3-8f06e1842cb9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.661431 Nov 25 08:44:57.165604 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 360/732] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:56 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:57.170637 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-70222b58-3a28-4e68-87a3-a0e75e62e241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'create', calling method: .version_select at 0x7f97084b9280>, body: {"keypair": {"name": "tempest-keypair-749487841"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:57.175628 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a6ee7556-a8b7-4e2b-8e5c-c89bceb2fa20 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1752 microversion: 2.1 time: 0.709576 Nov 25 08:44:57.177694 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 373/733] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:56 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1752 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:44:57.192818 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-70222b58-3a28-4e68-87a3-a0e75e62e241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:44:57.197856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-70222b58-3a28-4e68-87a3-a0e75e62e241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for user 30ca11853c4c45cb8d845bb83b86899c and project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:44:57.323152 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-70222b58-3a28-4e68-87a3-a0e75e62e241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:44:57.330743 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-70222b58-3a28-4e68-87a3-a0e75e62e241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for user 30ca11853c4c45cb8d845bb83b86899c and project af706c5a572d4008b111a87e96ebf814. Resources: {'key_pairs'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:44:57.347476 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-70222b58-3a28-4e68-87a3-a0e75e62e241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.180637 Nov 25 08:44:57.348125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 361/734] 10.222.0.46 () {62 vars in 1198 bytes} [Thu Nov 25 08:44:57 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 25 08:44:58.180806 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:58.181842 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:58.195360 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:58.198731 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:58.200275 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:58.201319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:58.210201 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:58.211427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:58.224543 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:58.225901 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:58.228215 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:58.228979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:58.634752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:58.659997 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:58.661989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-34407272-5c2c-4705-86dd-12641dc9e6a9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.491200 Nov 25 08:44:58.663207 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 374/735] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:58 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:58.670445 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-24a1df43-42c4-4223-a78e-6901b285b3fd tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.469764 Nov 25 08:44:58.682255 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 362/736] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:58 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:59.136427 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1677516469", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1f23e0-ed6b-4bcd-b801-85ff9727a35c"}], "security_groups": [{"name": "tempest-securitygroup--1992035950"}], "key_name": "tempest-keypair-749487841", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:44:59.249962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] validate_networks() for [('cd1f23e0-ed6b-4bcd-b801-85ff9727a35c', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:44:59.648214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:44:59.648631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:44:59.649106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:44:59.649509 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:44:59.649915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:44:59.659418 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:59.659930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:59.660736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:59.661158 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:59.680178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for project af706c5a572d4008b111a87e96ebf814. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:44:59.686413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Getting quotas for user 30ca11853c4c45cb8d845bb83b86899c and project af706c5a572d4008b111a87e96ebf814. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:44:59.692191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:59.693184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:59.703873 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:59.705097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:59.706543 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:59.707256 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:59.708269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:44:59.712428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:44:59.764049 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f7bac0d6-67bb-4fa2-a2ad-b87ae49068b2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631710 Nov 25 08:44:59.765754 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 375/737] 10.222.0.46 () {62 vars in 1187 bytes} [Thu Nov 25 08:44:59 2021] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 25 08:44:59.771873 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:59.772500 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:44:59.779335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:59.779821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:59.780634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:44:59.781101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:44:59.926269 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:44:59.938605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2107cb70-1d7a-44e5-9293-ee071f644ca1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.253026 Nov 25 08:44:59.939405 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 363/738] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:59 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:44:59.949810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d5e25479-1090-49e4-84e7-345f0b11d09e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:44:59.952932 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d5e25479-1090-49e4-84e7-345f0b11d09e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:00.048143 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:00.052348 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d5e25479-1090-49e4-84e7-345f0b11d09e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:00.061999 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c358c088-5ff0-4fd1-886c-157f34d43c29 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.294086 Nov 25 08:45:00.063801 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 376/739] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:44:59 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:00.065338 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d5e25479-1090-49e4-84e7-345f0b11d09e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:00.067201 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d5e25479-1090-49e4-84e7-345f0b11d09e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:00.068556 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d5e25479-1090-49e4-84e7-345f0b11d09e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1281 microversion: 2.20 time: 0.127451 Nov 25 08:45:00.069231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 364/740] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:44:59 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:00.425583 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-caf5c12a-9671-42ee-848c-8cc1b6ce2fcb req-d25a1512-4371-4b72-a5a6-03500cb1dd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054fbbf2-1e0b-4c8c-a440-1543622a65bd", "name": "network-vif-plugged", "status": "completed", "tag": "cb7bbad4-ef68-4a03-b97c-cdd848a53467"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:00.427350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:00.427350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:00.435861 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-caf5c12a-9671-42ee-848c-8cc1b6ce2fcb req-d25a1512-4371-4b72-a5a6-03500cb1dd1a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:00.436374 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-caf5c12a-9671-42ee-848c-8cc1b6ce2fcb req-d25a1512-4371-4b72-a5a6-03500cb1dd1a service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:00.449677 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-caf5c12a-9671-42ee-848c-8cc1b6ce2fcb req-d25a1512-4371-4b72-a5a6-03500cb1dd1a service nova] Creating event network-vif-plugged:cb7bbad4-ef68-4a03-b97c-cdd848a53467 for instance 054fbbf2-1e0b-4c8c-a440-1543622a65bd on hv-cinder-77819 Nov 25 08:45:00.455914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-caf5c12a-9671-42ee-848c-8cc1b6ce2fcb req-d25a1512-4371-4b72-a5a6-03500cb1dd1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034681 Nov 25 08:45:00.456534 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 377/741] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:00.966348 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:00.966976 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:00.974472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:00.974918 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:00.975740 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:00.976174 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:01.083170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:01.084169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:01.090903 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:01.091351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:01.092262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:01.092697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:01.134703 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:01.144669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-09dd695c-4111-436a-90bf-e07cbbd2ae0b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.181880 Nov 25 08:45:01.145594 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 365/742] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:00 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:01.150315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:01.150931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:01.158787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:01.159229 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:01.160277 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:01.160901 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:01.239887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:01.249928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:01.251949 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:01.253118 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3e9f392b-d0f6-4ac6-b268-32d7cdfa34c8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1285 microversion: 2.20 time: 0.106553 Nov 25 08:45:01.253702 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 366/743] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:01 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:01.304799 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:01.314117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-19b8b543-6635-46c4-939b-35728b7b8880 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.235554 Nov 25 08:45:01.314731 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 378/744] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:01 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:02.174921 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:02.175703 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:02.185804 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:02.186528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:02.187878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:02.189116 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:02.281982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:02.283890 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:02.295010 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:02.295900 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:02.297272 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:02.298010 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:02.430183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:02.445855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:02.449461 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:02.451983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:02.452335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e9606027-4e42-4d9b-a336-89bc03dce97e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1333 microversion: 2.20 time: 0.176398 Nov 25 08:45:02.453810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 379/745] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:02 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1333 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:02.460360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-80a8a85d-65c8-4686-8121-ee5e3d504aab tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.292664 Nov 25 08:45:02.460937 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 367/746] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:02 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:02.472878 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:02.474085 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:02.485953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:02.487529 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:02.488979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:02.489831 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:02.656015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:02.664632 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6f1d68e5-0510-46f8-9dc5-76bf02f6e6d8 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.199435 Nov 25 08:45:02.665263 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 380/747] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:02 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:03.481883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:03.482935 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:03.485150 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:03.486462 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:03.492554 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:03.492989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:03.493782 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:03.494210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:03.494379 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:03.495059 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:03.496438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:03.497182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:03.626875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:03.638338 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:03.640146 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:03.641766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cda74747-d371-4e02-8219-c36f68631c0a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1333 microversion: 2.20 time: 0.166966 Nov 25 08:45:03.642594 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 368/748] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:03 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:03.689394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:03.690505 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:03.700845 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:03.701624 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:03.703059 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:03.703868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:03.725799 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:03.734555 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-013f78cc-7057-4f1b-88c0-571179c68e30 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.253028 Nov 25 08:45:03.735794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 381/749] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:03 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:03.867409 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:03.877262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0692b613-e29c-4b08-af26-063be0d81f1a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.194368 Nov 25 08:45:03.877901 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 369/750] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:03 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:04.662110 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:04.662816 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:04.669930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:04.670421 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:04.671315 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:04.671844 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:04.741097 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:04.756657 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:04.757255 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:04.757441 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:04.760343 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:04.762377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-386b53fb-dd76-4b15-9419-d1199e6a5b75 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1333 microversion: 2.20 time: 0.104026 Nov 25 08:45:04.763498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 382/751] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:04 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:04.763988 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:04.764436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:04.765245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:04.765682 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:04.899941 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:04.901075 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:04.911758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:04.912549 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:04.913998 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:04.914790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:04.927166 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:04.935619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-33ace9d9-f39b-495e-998d-235f2e07c35e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.182491 Nov 25 08:45:04.936379 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 370/752] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:04 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:05.080802 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:05.090181 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7674e8d6-242d-448c-90b8-00e230cf7828 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.196650 Nov 25 08:45:05.090835 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 383/753] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:04 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:05.790320 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:05.790996 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:05.798230 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:05.798664 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:05.799460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:05.799921 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:05.879943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:05.895960 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:05.899163 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:05.901071 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d68a7279-c884-4c1b-9a26-cd7d2d97b479 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1333 microversion: 2.20 time: 0.114221 Nov 25 08:45:05.908149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 371/754] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:05 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:45:05.961560 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:05.962785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:05.974507 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:05.975239 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:05.976676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:05.977430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:06.113432 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:06.114542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:06.123301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:06.123801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:06.124904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:06.128577 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:06.333952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:06.342013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2d078738-02fe-4341-a079-695cb5b50845 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1314 microversion: 2.1 time: 0.388914 Nov 25 08:45:06.343075 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 384/755] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:05 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:06.477637 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:06.489373 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4598cdb2-6bae-47ed-bb8b-a4f2de5ae991 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.383623 Nov 25 08:45:06.490433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 372/756] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:06 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:06.924214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:06.925342 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:06.936407 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:06.937494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:06.939043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:06.939869 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.201399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:07.202180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:07.216185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.217040 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.218119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.218735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.259807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:07.276051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:07.279238 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:07.280318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Going to try to terminate instance {{(pid=122643) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:45:07.281575 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8aa6e723-f2e2-4c2c-8c11-294b133b70f3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.361969 Nov 25 08:45:07.283787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 385/757] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:06 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:45:07.366008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:07.367140 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:07.379665 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.380485 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.381982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.382549 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.434345 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-84f6572f-4adb-4590-b928-7b883840b648 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 204 len: 0 microversion: 2.1 time: 0.239179 Nov 25 08:45:07.437386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 373/758] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:45:07 2021] DELETE /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:45:07.457470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:07.459224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:07.473468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.474468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.476264 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.477433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.857051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:07.868890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:07.872185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-818ce246-162b-41b9-a5e4-27f049aad9ee tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1498 microversion: 2.1 time: 0.514097 Nov 25 08:45:07.888735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 386/759] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:07 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1498 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:07.894498 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ecda14a9-6b22-4c9c-829a-568f10e650d4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1575 microversion: 2.1 time: 0.445554 Nov 25 08:45:07.894498 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 374/760] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:07 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1575 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:07.904023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:07.905645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:07.921209 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.921532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:07.922258 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:07.923363 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.311524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:08.312452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:08.314970 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:08.329966 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7273e797-5fe0-48bd-8ea2-552b76844c50 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.438527 Nov 25 08:45:08.331513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 387/761] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:07 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:08.346388 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.346961 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.347928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.349912 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.472004 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-79ecad47-df56-44a7-9192-c3c138369aee req-108e31a6-02b1-4fdb-acd5-0e2b93e32578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf899124-0fb5-489e-a87e-f94a838091d7", "tag": "358bd9c3-fe7c-46ac-9c3c-82e4369e8f66"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:08.473986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:08.473986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:08.485829 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-79ecad47-df56-44a7-9192-c3c138369aee req-108e31a6-02b1-4fdb-acd5-0e2b93e32578 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.486724 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-79ecad47-df56-44a7-9192-c3c138369aee req-108e31a6-02b1-4fdb-acd5-0e2b93e32578 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.504292 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-79ecad47-df56-44a7-9192-c3c138369aee req-108e31a6-02b1-4fdb-acd5-0e2b93e32578 service nova] Creating event network-changed:358bd9c3-fe7c-46ac-9c3c-82e4369e8f66 for instance bf899124-0fb5-489e-a87e-f94a838091d7 on hv-cinder-77819 Nov 25 08:45:08.513285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-79ecad47-df56-44a7-9192-c3c138369aee req-108e31a6-02b1-4fdb-acd5-0e2b93e32578 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053555 Nov 25 08:45:08.514302 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 388/762] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:45:08.586396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:08.598356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:08.600780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:08.602375 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d1fe1c60-a6f8-4202-a942-4d17e3a05c59 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.299905 Nov 25 08:45:08.603208 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 375/763] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:08 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:08.702591 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:08.704483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:08.712157 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.712605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.713458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.714181 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.749234 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:45:08.857004 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cadede4c-e28e-4117-9e4e-5611588c6cc9 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 204 len: 0 microversion: 2.1 time: 0.160543 Nov 25 08:45:08.863990 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 389/764] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:45:08 2021] DELETE /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 25 08:45:08.871525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:08.872506 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:08.883824 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.884418 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.885449 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.886164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.916355 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:08.917969 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:08.928487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.929214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:08.930540 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:08.931273 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:09.205782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:09.214262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9acc2962-19c3-427d-ab83-5fa5e2ef4073 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1504 microversion: 2.1 time: 0.348360 Nov 25 08:45:09.214865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 376/765] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:08 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:09.262160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:09.273642 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d43f9c9b-1fe9-4669-bacd-e894e7a197a9 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1575 microversion: 2.1 time: 0.364777 Nov 25 08:45:09.274605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 390/766] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:08 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1575 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:09.353785 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:09.354981 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:09.367088 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:09.368624 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:09.370147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:09.371875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:09.624126 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:09.625185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:09.633222 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:09.633222 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:09.633553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:09.633930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:09.939691 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:09.948719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4ec363bf-247b-4194-a304-81ff889fea3e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.599230 Nov 25 08:45:09.949312 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 377/767] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:09 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:10.232367 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:10.232888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:10.239872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:10.240321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:10.241326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:10.241763 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:10.281442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:10.291915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:10.293837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:10.296609 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-83280054-3372-40a9-ae9a-3b95d563207a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.678410 Nov 25 08:45:10.311597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 391/768] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:09 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:45:10.311597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:10.311597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:10.319281 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:10.320171 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:10.322566 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:10.323781 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:11.009317 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:11.028407 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dcaa9aad-feaa-4341-9175-b8ee2573b042 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1504 microversion: 2.1 time: 0.799119 Nov 25 08:45:11.054814 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 378/769] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:10 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1504 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:11.064872 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:11.089656 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-85131f7d-8294-4e58-965e-53a8a9fa5539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1575 microversion: 2.1 time: 0.789577 Nov 25 08:45:11.091639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:11.093148 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:11.098447 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 392/770] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:10 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1575 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:11.108697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:11.110740 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:11.112975 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:11.114159 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:11.337647 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:11.338825 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:11.370468 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:11.372047 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:11.376070 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:11.377631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:11.475779 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:11.487127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6762e7d3-8db5-48f0-b548-648732ef3bf4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.430246 Nov 25 08:45:11.487870 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 379/771] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:11 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:11.580540 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-bd5d3e06-0965-442d-948c-989a9595d0fc req-aa8e9a43-0820-4954-a569-7595d7979e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054fbbf2-1e0b-4c8c-a440-1543622a65bd", "name": "network-vif-deleted", "tag": "cb7bbad4-ef68-4a03-b97c-cdd848a53467"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:11.582644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:11.582644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:11.595673 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-bd5d3e06-0965-442d-948c-989a9595d0fc req-aa8e9a43-0820-4954-a569-7595d7979e4e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:11.595673 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-bd5d3e06-0965-442d-948c-989a9595d0fc req-aa8e9a43-0820-4954-a569-7595d7979e4e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:11.606772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-bd5d3e06-0965-442d-948c-989a9595d0fc req-aa8e9a43-0820-4954-a569-7595d7979e4e service nova] Creating event network-vif-deleted:cb7bbad4-ef68-4a03-b97c-cdd848a53467 for instance 054fbbf2-1e0b-4c8c-a440-1543622a65bd on hv-cinder-77819 Nov 25 08:45:11.613406 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-bd5d3e06-0965-442d-948c-989a9595d0fc req-aa8e9a43-0820-4954-a569-7595d7979e4e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Nov 25 08:45:11.615748 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 380/772] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:45:11.683600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:11.703880 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:11.709490 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:11.716509 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-969d1b7a-4d53-4e8f-951c-540397734ab0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.393454 Nov 25 08:45:11.720821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 393/773] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:11 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:11.976571 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-d8bad125-df42-4c9d-86e6-2bfa43f5c101 req-e01ea484-49a0-4d0d-8233-9deaba6508c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee504ef-51bf-44f8-a9a2-222f68d2cd9b", "name": "network-vif-deleted", "tag": "3eab4787-6ee8-4eb6-8d64-63594ea60f24"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:11.980131 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:11.980131 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:11.993453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-d8bad125-df42-4c9d-86e6-2bfa43f5c101 req-e01ea484-49a0-4d0d-8233-9deaba6508c8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:11.993888 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-d8bad125-df42-4c9d-86e6-2bfa43f5c101 req-e01ea484-49a0-4d0d-8233-9deaba6508c8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.008208 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-d8bad125-df42-4c9d-86e6-2bfa43f5c101 req-e01ea484-49a0-4d0d-8233-9deaba6508c8 service nova] Creating event network-vif-deleted:3eab4787-6ee8-4eb6-8d64-63594ea60f24 for instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b on hv-cinder-77819 Nov 25 08:45:12.014537 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-d8bad125-df42-4c9d-86e6-2bfa43f5c101 req-e01ea484-49a0-4d0d-8233-9deaba6508c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046852 Nov 25 08:45:12.018185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 381/774] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:12.064014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:12.065404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:12.074746 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.075817 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.078793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.080051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.119156 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.119590 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.120058 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lazy-loading 'fault' on Instance uuid 054fbbf2-1e0b-4c8c-a440-1543622a65bd {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:45:12.129400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:12.130292 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:12.144182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.144728 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.148669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.149437 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.169432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:12.180200 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1c17cd96-ee74-4f0b-a1db-4689e502794b tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 200 len: 1304 microversion: 2.1 time: 0.125817 Nov 25 08:45:12.180863 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 394/775] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:12 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:12.240191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:12.251286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c11a6f8f-588d-44af-b779-0b7e2e7df541 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 200 len: 1224 microversion: 2.1 time: 0.128312 Nov 25 08:45:12.262543 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 382/776] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:12 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 1224 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:12.514399 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:12.515483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:12.524537 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.525447 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.526814 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.527931 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.741503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:12.742332 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:12.755328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.756073 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.757689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:12.758376 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:12.794938 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:12.807170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-59aef87a-12fe-49ef-8f45-ffca4184215a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.297305 Nov 25 08:45:12.808371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 395/777] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:12 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:12.997104 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:13.011746 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:13.014656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:13.017371 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d40ee03a-017b-47dc-a216-7878314f19fb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.280583 Nov 25 08:45:13.018352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 383/778] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:12 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:13.198353 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:13.199032 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: 054fbbf2-1e0b-4c8c-a440-1543622a65bd] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:13.206690 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:13.207131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:13.207965 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:13.208393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:13.223320 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] HTTP exception thrown: Instance 054fbbf2-1e0b-4c8c-a440-1543622a65bd could not be found. Nov 25 08:45:13.223953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Returning 404 to user: Instance 054fbbf2-1e0b-4c8c-a440-1543622a65bd could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:45:13.224782 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-efbf47e3-ec2a-4932-9d84-3289255035aa tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd" status: 404 len: 111 microversion: 2.1 time: 0.030194 Nov 25 08:45:13.228293 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 396/779] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:13 2021] GET /compute/v2.1/servers/054fbbf2-1e0b-4c8c-a440-1543622a65bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:45:13.270771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:13.272005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:13.280514 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-298120449", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "9d63ce6f-4cd1-4d31-b308-a6ca97fe31c4"}]}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:13.280922 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:13.281475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:13.282783 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:13.283211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:13.298424 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] HTTP exception thrown: Instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b could not be found. Nov 25 08:45:13.299198 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Returning 404 to user: Instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:45:13.300099 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b46fdb01-9199-40d3-880f-c42591f95539 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 404 len: 111 microversion: 2.1 time: 0.033459 Nov 25 08:45:13.300654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 384/780] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:13 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:45:13.375592 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] validate_networks() for [('9d63ce6f-4cd1-4d31-b308-a6ca97fe31c4', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:45:13.443051 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1370335695", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-739661517", "security_groups": [{"name": "tempest-secgroup-smoke-497791862"}], "block_device_mapping_v2": [{"uuid": "50c0417f-0bf8-4c1f-b7fc-3d8b57c04cb9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b7242cf-308b-4aee-a391-1d7432608cad"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:13.696536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] validate_networks() for [('0b7242cf-308b-4aee-a391-1d7432608cad', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:45:14.125092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:45:14.126532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:45:14.127081 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:45:14.127580 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:45:14.128085 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:45:14.149780 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.150377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.151500 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.152004 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.174799 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Getting quotas for project b12215da390b49b9ba3f302c6a19a80a. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:45:14.181980 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Getting quotas for user 63b4fe6fb539453681ca6870f6997ad8 and project b12215da390b49b9ba3f302c6a19a80a. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:45:14.198337 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:45:14.201105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:45:14.254564 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ec05d9d8-57ce-4564-b5bc-12738ea8fe7a tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977556 Nov 25 08:45:14.256151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 397/781] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:45:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 25 08:45:14.261641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:14.262303 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:14.269785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.270236 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.271072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.271516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.376279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:45:14.377259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:45:14.377897 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:45:14.378298 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:45:14.378707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:45:14.388233 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.388675 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.389507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.389935 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.410553 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:45:14.415257 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for user 16a2f54eb10148c48a3cdd2641da5315 and project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:45:14.481891 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:45:14.485835 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50c0417f-0bf8-4c1f-b7fc-3d8b57c04cb9',volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:45:14.486122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:14.494572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-dd04e8d2-f381-4a42-83d4-c9c15bb1e364 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.237039 Nov 25 08:45:14.495325 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 398/782] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:14 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:14.500669 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:14.501452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:14.508160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.508604 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.509386 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:14.510520 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:14.655656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ee1ebbab-fa84-4034-8e9f-c95ffaa0f275 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.220294 Nov 25 08:45:14.657070 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 385/783] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:45:13 2021] POST /compute/v2.1/servers => generated 405 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 25 08:45:14.663665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-951e8916-06c0-405d-a166-30e83f3518f1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:14.664852 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-951e8916-06c0-405d-a166-30e83f3518f1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:14.735203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:14.745418 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-951e8916-06c0-405d-a166-30e83f3518f1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:14.752103 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:14.752452 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-951e8916-06c0-405d-a166-30e83f3518f1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1213 microversion: 2.1 time: 0.093401 Nov 25 08:45:14.753032 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 386/784] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:14 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:14.754837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:14.756544 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-99f477b5-7c5a-46bb-b615-02e0b6584e65 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.259636 Nov 25 08:45:14.757558 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 399/785] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:14 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:14.758469 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bfe85cd8-16f1-4944-a155-2a28dc119bd8 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:14.759148 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bfe85cd8-16f1-4944-a155-2a28dc119bd8 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:14.823449 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-bfe85cd8-16f1-4944-a155-2a28dc119bd8 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:14.831650 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bfe85cd8-16f1-4944-a155-2a28dc119bd8 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1094 microversion: 2.1 time: 0.076580 Nov 25 08:45:14.832387 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 387/786] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:14 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:15.511865 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:15.512499 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:15.519322 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.519796 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.520585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.521021 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.686073 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:15.695165 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c20aa312-58c2-496e-bf85-03502beec1c0 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.187021 Nov 25 08:45:15.695794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 400/787] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:15 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:15.771113 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:15.771697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:15.779290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.779871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.780669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.781114 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.786189 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:15.787216 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:15.806526 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.806976 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.807795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.808229 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.846789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:15.854259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4c2bd2f1-a391-40e6-931e-194716e4f5ec tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1217 microversion: 2.1 time: 0.086880 Nov 25 08:45:15.854851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 388/788] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:15 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:15.859677 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:15.860351 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:15.870443 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.870986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.871834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:15.872269 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:15.992526 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:16.006622 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cbd87505-2b71-441d-8fc7-611af0167f34 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1144 microversion: 2.1 time: 0.150702 Nov 25 08:45:16.007518 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 389/789] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:15 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1144 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:16.049533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:16.059989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:16.063776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:16.065915 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-22068fdf-d937-4068-8c74-8394eb5eae8d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.286812 Nov 25 08:45:16.066729 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 401/790] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:15 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:16.714461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:16.715448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:16.725119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:16.725726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:16.726693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:16.727279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:16.878549 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:16.879206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:16.887687 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:16.888215 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:16.889137 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:16.889582 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:16.997567 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:17.005417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-aa7b81d1-13dd-447f-baa5-239d76c8fb1f tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1271 microversion: 2.1 time: 0.133441 Nov 25 08:45:17.007499 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 402/791] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:16 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:17.033453 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:17.034367 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:17.041563 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:17.042060 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:17.043181 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:17.043694 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:17.069342 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:17.082892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b9b74f00-7030-482c-83b9-52a2b316cf80 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1757 microversion: 2.1 time: 0.372872 Nov 25 08:45:17.083818 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 390/792] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:16 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1757 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:17.100940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:17.101587 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:17.113686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:17.114619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:17.123541 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:17.126821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:17.162075 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:17.174074 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-11cdc74e-7c38-4cf6-b202-3e18cb421e96 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1210 microversion: 2.1 time: 0.146323 Nov 25 08:45:17.184438 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 403/793] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:17 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:17.404572 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:17.426910 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:17.431315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:17.434794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a61af0f4-c664-408e-895d-8540d4916b90 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.343266 Nov 25 08:45:17.436513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 391/794] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:17 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:45:18.034524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:18.036830 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:18.052022 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:18.054221 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:18.055487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:18.056344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:18.080907 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-d0b57bc6-8e2d-4111-b5c3-43826a316370 req-3d08d310-bec5-41b6-b3f1-bcf8abb63db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf899124-0fb5-489e-a87e-f94a838091d7", "name": "network-vif-plugged", "status": "completed", "tag": "358bd9c3-fe7c-46ac-9c3c-82e4369e8f66"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:18.089052 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:18.089052 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:18.126927 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-d0b57bc6-8e2d-4111-b5c3-43826a316370 req-3d08d310-bec5-41b6-b3f1-bcf8abb63db8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:18.127836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-d0b57bc6-8e2d-4111-b5c3-43826a316370 req-3d08d310-bec5-41b6-b3f1-bcf8abb63db8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:18.167417 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-d0b57bc6-8e2d-4111-b5c3-43826a316370 req-3d08d310-bec5-41b6-b3f1-bcf8abb63db8 service nova] Creating event network-vif-plugged:358bd9c3-fe7c-46ac-9c3c-82e4369e8f66 for instance bf899124-0fb5-489e-a87e-f94a838091d7 on hv-cinder-77819 Nov 25 08:45:18.176410 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-d0b57bc6-8e2d-4111-b5c3-43826a316370 req-3d08d310-bec5-41b6-b3f1-bcf8abb63db8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109781 Nov 25 08:45:18.177761 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 392/795] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:18.184576 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:18.185621 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:18.206958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:18.212509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:18.215164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:18.217728 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.275416 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:19.289297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-926ba40f-9b83-46f2-9126-4d7b5b129204 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1313 microversion: 2.1 time: 1.263265 Nov 25 08:45:19.290666 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 404/796] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:18 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1313 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:19.297234 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:19.298167 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:19.306126 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.306611 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.307804 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.308285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.347476 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:19.368802 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-84dcd231-aefa-46d7-837a-d1a8e7ddc7a7 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1760 microversion: 2.1 time: 1.182023 Nov 25 08:45:19.398265 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 393/797] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:18 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1760 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:19.416536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7a770657-a20e-46bc-a09d-294b170b3fc9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:19.419089 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7a770657-a20e-46bc-a09d-294b170b3fc9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:19.428103 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a770657-a20e-46bc-a09d-294b170b3fc9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.430318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a770657-a20e-46bc-a09d-294b170b3fc9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.431646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a770657-a20e-46bc-a09d-294b170b3fc9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.432270 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7a770657-a20e-46bc-a09d-294b170b3fc9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.487741 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7a770657-a20e-46bc-a09d-294b170b3fc9 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087774 Nov 25 08:45:19.493548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 394/798] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:45:19 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:45:19.506754 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:19.507893 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:19.515126 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.516681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.517721 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.518345 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.676713 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:19.688384 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0f74b36f-9db8-46a1-9160-76f67570f287 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.394643 Nov 25 08:45:19.690511 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 405/799] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:19 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:19.701043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:19.702445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:19.713621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.714376 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.715435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.716139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.775631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:45:19.798737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:19.808810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:19.816919 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:19.818488 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ee137030-ada8-4396-8884-b5bec2ced17a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1407 microversion: 2.20 time: 0.327739 Nov 25 08:45:19.821447 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 395/800] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:19 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:45:19.832889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-565fd372-6b6b-4aaf-85e4-6c780fab0f9f req-ae69b4d7-a893-48c0-9461-383efb7d0ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b940ec-da83-47d2-81eb-2b12373a55ae", "tag": "a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:19.832889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:19.832889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:19.841837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-565fd372-6b6b-4aaf-85e4-6c780fab0f9f req-ae69b4d7-a893-48c0-9461-383efb7d0ebf service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.842384 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-565fd372-6b6b-4aaf-85e4-6c780fab0f9f req-ae69b4d7-a893-48c0-9461-383efb7d0ebf service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.857476 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-565fd372-6b6b-4aaf-85e4-6c780fab0f9f req-ae69b4d7-a893-48c0-9461-383efb7d0ebf service nova] Creating event network-changed:a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf for instance d8b940ec-da83-47d2-81eb-2b12373a55ae on hv-cinder-77819 Nov 25 08:45:19.864155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-565fd372-6b6b-4aaf-85e4-6c780fab0f9f req-ae69b4d7-a893-48c0-9461-383efb7d0ebf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041193 Nov 25 08:45:19.865231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 396/801] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:19.926574 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-71ffbe49-d4ec-49de-aba2-876a2a61f10b req-e0c79eb1-db7f-4f05-929f-d6789d4b0ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09aa1f4-de4e-4cf5-9816-b9f2f849eca3", "tag": "a4bd6569-b525-42e6-88d5-9a1331eb2ad1"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:19.928295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:19.928295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:19.939094 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f6b7b480-647c-49a0-90d9-e490798f628f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 204 len: 0 microversion: 2.1 time: 0.245896 Nov 25 08:45:19.940160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 406/802] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:45:19 2021] DELETE /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:45:19.951125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-71ffbe49-d4ec-49de-aba2-876a2a61f10b req-e0c79eb1-db7f-4f05-929f-d6789d4b0ef4 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.952334 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:19.954131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:19.958687 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-71ffbe49-d4ec-49de-aba2-876a2a61f10b req-e0c79eb1-db7f-4f05-929f-d6789d4b0ef4 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.963405 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.964066 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.965494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:19.966389 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:19.991065 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-71ffbe49-d4ec-49de-aba2-876a2a61f10b req-e0c79eb1-db7f-4f05-929f-d6789d4b0ef4 service nova] Creating event network-changed:a4bd6569-b525-42e6-88d5-9a1331eb2ad1 for instance a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 on hv-cinder-77819 Nov 25 08:45:20.008666 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-71ffbe49-d4ec-49de-aba2-876a2a61f10b req-e0c79eb1-db7f-4f05-929f-d6789d4b0ef4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090107 Nov 25 08:45:20.011665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 397/803] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 25 08:45:20.268714 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:20.283194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-47b73a6c-80bc-4831-bc9a-040ced051a78 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1671 microversion: 2.1 time: 0.337581 Nov 25 08:45:20.296127 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 407/804] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:19 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1671 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:20.317879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:20.319183 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:20.331467 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:20.332559 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:20.336321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:20.336883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:20.710040 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:20.710767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:20.723613 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:20.724195 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:20.725253 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:20.726599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:20.729116 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:20.742725 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-75ac8dd4-a804-4004-8282-d60b32e1fd12 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1313 microversion: 2.1 time: 0.434510 Nov 25 08:45:20.747010 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 398/805] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:20 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:20.839872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:20.840766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:20.848057 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:20.848775 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:20.852227 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:20.852994 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:21.058886 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:21.077403 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c9681d72-d485-4ebc-9bab-ba256f16bb8c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.374071 Nov 25 08:45:21.079232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 408/806] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:20 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:21.185376 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:21.194350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:21.196002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:21.198366 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c10bfd74-1ad6-4367-bece-6d38f81df8cd tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1599 microversion: 2.20 time: 0.361546 Nov 25 08:45:21.200453 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 399/807] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:45:20 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1599 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:45:21.224178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d0edbf13-bc7f-4685-bdf9-e83b7b5b21a1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:21.225286 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d0edbf13-bc7f-4685-bdf9-e83b7b5b21a1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:21.237040 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0edbf13-bc7f-4685-bdf9-e83b7b5b21a1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:21.237981 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0edbf13-bc7f-4685-bdf9-e83b7b5b21a1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:21.239886 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0edbf13-bc7f-4685-bdf9-e83b7b5b21a1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:21.240315 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d0edbf13-bc7f-4685-bdf9-e83b7b5b21a1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:21.309735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:21.310286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:21.331502 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:21.333545 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:21.335336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:21.338875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:21.432029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d0edbf13-bc7f-4685-bdf9-e83b7b5b21a1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.217553 Nov 25 08:45:21.433906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 409/808] 10.222.0.46 () {60 vars in 1315 bytes} [Thu Nov 25 08:45:21 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:45:21.602437 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:21.615394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5df2ec35-197e-4354-a745-5c417295e73e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1671 microversion: 2.1 time: 0.315927 Nov 25 08:45:21.616152 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 400/809] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:21 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1671 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:21.761220 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:21.761835 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:21.768170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:21.768625 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:21.769431 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:21.770048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:21.935297 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:21.949476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d837a6e4-b306-45c2-9695-4452693961e5 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1313 microversion: 2.1 time: 0.192163 Nov 25 08:45:21.950885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 410/810] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:21 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:22.097879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:22.099212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:22.105821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:22.106507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:22.107380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:22.108038 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:22.314737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:22.324658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-af7788be-f24b-453a-bc51-1b37a3a872c3 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.231399 Nov 25 08:45:22.326583 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 401/811] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:22 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:22.636153 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:22.638237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:22.651994 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:22.652565 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:22.653476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:22.654028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:22.813837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-00b92c4a-e9c4-484d-9a7a-db6fa1723449 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:22.814843 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-00b92c4a-e9c4-484d-9a7a-db6fa1723449 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:22.823054 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-00b92c4a-e9c4-484d-9a7a-db6fa1723449 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:22.823849 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-00b92c4a-e9c4-484d-9a7a-db6fa1723449 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:22.825777 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-00b92c4a-e9c4-484d-9a7a-db6fa1723449 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:22.826408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-00b92c4a-e9c4-484d-9a7a-db6fa1723449 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:22.903656 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:22.908974 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-00b92c4a-e9c4-484d-9a7a-db6fa1723449 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.089429 Nov 25 08:45:22.917103 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 402/812] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:22 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:22.923604 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-5269f164-734e-467d-94cb-202453f864ac req-42b56c66-aba6-4d88-9c17-7ef3f6983ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf899124-0fb5-489e-a87e-f94a838091d7", "tag": "358bd9c3-fe7c-46ac-9c3c-82e4369e8f66"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:22.924048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7f11ca55-2a34-45b0-8885-f270d95c5d4b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1671 microversion: 2.1 time: 0.284698 Nov 25 08:45:22.925236 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 411/813] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:22 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:22.927097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:22.927097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:22.936458 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-5269f164-734e-467d-94cb-202453f864ac req-42b56c66-aba6-4d88-9c17-7ef3f6983ceb service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:22.937179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-5269f164-734e-467d-94cb-202453f864ac req-42b56c66-aba6-4d88-9c17-7ef3f6983ceb service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:22.951955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-5269f164-734e-467d-94cb-202453f864ac req-42b56c66-aba6-4d88-9c17-7ef3f6983ceb service nova] Creating event network-changed:358bd9c3-fe7c-46ac-9c3c-82e4369e8f66 for instance bf899124-0fb5-489e-a87e-f94a838091d7 on hv-cinder-77819 Nov 25 08:45:22.957728 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-5269f164-734e-467d-94cb-202453f864ac req-42b56c66-aba6-4d88-9c17-7ef3f6983ceb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038769 Nov 25 08:45:22.959008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 403/814] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:22.983430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:22.993283 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:23.003671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.005154 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:23.008109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.009421 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:23.346774 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:23.348529 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:23.355410 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.356346 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:23.357462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.358368 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:23.477469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:23.503262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1f2dfb54-b71a-4b66-b53b-d8eab168bf11 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1313 microversion: 2.1 time: 0.528963 Nov 25 08:45:23.518668 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 412/815] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:22 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:23.676057 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:23.688540 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2b1bb878-2d55-409a-ba17-c2ad6f779c43 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.341916 Nov 25 08:45:23.689207 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 404/816] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:23 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:23.930946 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-839c8635-752e-43bc-adae-06c0fcb2450b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:23.932115 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-839c8635-752e-43bc-adae-06c0fcb2450b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:23.942100 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-839c8635-752e-43bc-adae-06c0fcb2450b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.942562 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-839c8635-752e-43bc-adae-06c0fcb2450b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:23.945629 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-839c8635-752e-43bc-adae-06c0fcb2450b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.946178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-839c8635-752e-43bc-adae-06c0fcb2450b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:23.966356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:23.968780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:23.981140 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.982350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:23.984882 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:23.985857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:24.032560 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-839c8635-752e-43bc-adae-06c0fcb2450b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.105329 Nov 25 08:45:24.034577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 413/817] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:23 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:24.066591 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:24.080400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-de00bd71-fa0d-46df-99ad-e85cd2038dc3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 200 len: 1604 microversion: 2.1 time: 0.121264 Nov 25 08:45:24.081904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 405/818] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:23 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:24.302993 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-d19946ae-e1b8-4c4f-8121-283b091a0431 req-a45dfe0f-056d-4705-895a-24bd18b6d0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1aedc08-397b-4391-8040-58633cd7f2b0", "name": "network-vif-deleted", "tag": "9924f829-de6d-4b9e-b3ef-17a50b2a8e5f"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:24.304844 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:24.304844 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:24.324250 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d19946ae-e1b8-4c4f-8121-283b091a0431 req-a45dfe0f-056d-4705-895a-24bd18b6d0c1 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:24.325549 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-d19946ae-e1b8-4c4f-8121-283b091a0431 req-a45dfe0f-056d-4705-895a-24bd18b6d0c1 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:24.351105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-d19946ae-e1b8-4c4f-8121-283b091a0431 req-a45dfe0f-056d-4705-895a-24bd18b6d0c1 service nova] Creating event network-vif-deleted:9924f829-de6d-4b9e-b3ef-17a50b2a8e5f for instance d1aedc08-397b-4391-8040-58633cd7f2b0 on hv-cinder-77819 Nov 25 08:45:24.357426 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-d19946ae-e1b8-4c4f-8121-283b091a0431 req-a45dfe0f-056d-4705-895a-24bd18b6d0c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059445 Nov 25 08:45:24.358410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 414/819] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:24.535059 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:24.536102 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:24.554339 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:24.554471 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:24.555262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:24.555715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:24.708949 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:24.712277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:24.729460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:24.731309 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:24.732586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:24.734610 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:24.792014 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:24.805701 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-687c1cab-580f-47a9-8300-7c9712f9fca4 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1313 microversion: 2.1 time: 0.279418 Nov 25 08:45:24.808332 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 406/820] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:24 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:25.045825 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dc3901d6-b47e-4560-898d-f5cb6a3de006 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:25.047657 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:25.048158 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dc3901d6-b47e-4560-898d-f5cb6a3de006 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:25.057621 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc3901d6-b47e-4560-898d-f5cb6a3de006 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:25.058279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc3901d6-b47e-4560-898d-f5cb6a3de006 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:25.058740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a915857f-1a32-4820-924f-eb5d749be2f6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.356711 Nov 25 08:45:25.059487 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc3901d6-b47e-4560-898d-f5cb6a3de006 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:25.060279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc3901d6-b47e-4560-898d-f5cb6a3de006 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:25.071349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 415/821] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:24 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:25.099707 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:25.100895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:25.109797 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:25.110553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:25.111811 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:25.112472 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:25.132837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] HTTP exception thrown: Instance d1aedc08-397b-4391-8040-58633cd7f2b0 could not be found. Nov 25 08:45:25.133897 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Returning 404 to user: Instance d1aedc08-397b-4391-8040-58633cd7f2b0 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:45:25.134819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3b91f6e2-cec9-437a-8eab-3822a9b92d52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 404 len: 111 microversion: 2.1 time: 0.039001 Nov 25 08:45:25.135466 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 416/822] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:25 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:45:25.144077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dc3901d6-b47e-4560-898d-f5cb6a3de006 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.102186 Nov 25 08:45:25.144726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 407/823] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:25 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:25.151430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4957bf5a-985b-42d7-8a57-bfed47dac8a5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '.version_select at 0x7f97085e2820>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:25.178541 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4957bf5a-985b-42d7-8a57-bfed47dac8a5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753818226" status: 202 len: 0 microversion: 2.1 time: 0.036026 Nov 25 08:45:25.179072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 417/824] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Nov 25 08:45:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753818226 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:25.825955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:25.828457 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:25.872601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:25.874189 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:25.898367 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:25.905484 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:26.057233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-8ea8bafc-093f-479a-8e7d-6c295d2b51ec req-24115ec6-4ae2-4cfc-b15a-b522905d19f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09aa1f4-de4e-4cf5-9816-b9f2f849eca3", "name": "network-vif-plugged", "status": "completed", "tag": "a4bd6569-b525-42e6-88d5-9a1331eb2ad1"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:26.064304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:26.064304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:26.087301 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-8ea8bafc-093f-479a-8e7d-6c295d2b51ec req-24115ec6-4ae2-4cfc-b15a-b522905d19f9 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:26.087791 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-8ea8bafc-093f-479a-8e7d-6c295d2b51ec req-24115ec6-4ae2-4cfc-b15a-b522905d19f9 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:26.100098 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-8ea8bafc-093f-479a-8e7d-6c295d2b51ec req-24115ec6-4ae2-4cfc-b15a-b522905d19f9 service nova] Creating event network-vif-plugged:a4bd6569-b525-42e6-88d5-9a1331eb2ad1 for instance a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 on hv-cinder-77819 Nov 25 08:45:26.105424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-8ea8bafc-093f-479a-8e7d-6c295d2b51ec req-24115ec6-4ae2-4cfc-b15a-b522905d19f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053364 Nov 25 08:45:26.106149 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 418/825] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:45:26.112674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:26.113377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:26.121669 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:26.121948 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:26.122954 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:26.123640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:26.404503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:26.413027 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-789aa53f-8ccb-4849-9e0e-c98f83acb0fe tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1313 microversion: 2.1 time: 0.592658 Nov 25 08:45:26.413619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 408/826] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:25 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:26.418192 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-da5380cb-0ab5-4dce-983c-7996c1a274f1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:26.419129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-da5380cb-0ab5-4dce-983c-7996c1a274f1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:26.427983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da5380cb-0ab5-4dce-983c-7996c1a274f1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:26.428439 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da5380cb-0ab5-4dce-983c-7996c1a274f1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:26.429235 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da5380cb-0ab5-4dce-983c-7996c1a274f1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:26.429665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-da5380cb-0ab5-4dce-983c-7996c1a274f1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:26.468975 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:26.476752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d08d7257-0e91-4477-8156-3a23b777afcb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.369267 Nov 25 08:45:26.477339 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 419/827] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:26 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:26.482566 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d8c88f96-bb26-48e2-a172-40791186684f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'create', calling method: .version_select at 0x7f970858fca0>, body: {"keypair": {"name": "tempest-keypair-867805245"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:26.501383 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-d8c88f96-bb26-48e2-a172-40791186684f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:45:26.507445 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-da5380cb-0ab5-4dce-983c-7996c1a274f1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.092460 Nov 25 08:45:26.508171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 409/828] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:26 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:26.509661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-d8c88f96-bb26-48e2-a172-40791186684f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for user a25f49cbab094baabb82829b4b71a5e7 and project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:45:26.885597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-d8c88f96-bb26-48e2-a172-40791186684f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:45:26.890511 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-d8c88f96-bb26-48e2-a172-40791186684f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for user a25f49cbab094baabb82829b4b71a5e7 and project eb52ad5308c241089b4e2e8f09206f74. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:45:26.904637 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d8c88f96-bb26-48e2-a172-40791186684f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.426243 Nov 25 08:45:26.905349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 420/829] 10.222.0.46 () {60 vars in 1157 bytes} [Thu Nov 25 08:45:26 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:27.431360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:27.432173 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:27.440335 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:27.440785 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:27.441834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:27.442515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:27.500959 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:27.503394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:27.518096 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:27.521008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:27.523395 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:27.524212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:27.740289 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:27.750376 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d425f9b5-5128-49d2-8980-2b0cfde1d7cd tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1313 microversion: 2.1 time: 0.322871 Nov 25 08:45:27.761153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 410/830] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:27 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:27.767353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-56364aee-ebe8-45b2-8c67-78236929d015 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:27.768649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-56364aee-ebe8-45b2-8c67-78236929d015 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:27.775721 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-56364aee-ebe8-45b2-8c67-78236929d015 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:27.776542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-56364aee-ebe8-45b2-8c67-78236929d015 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:27.777706 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-56364aee-ebe8-45b2-8c67-78236929d015 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:27.777881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-56364aee-ebe8-45b2-8c67-78236929d015 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:27.870680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:27.884638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-81552375-3617-4d28-92b8-c4c9ffefb5e2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.391942 Nov 25 08:45:27.885864 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 421/831] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:27 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:27.899806 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-56364aee-ebe8-45b2-8c67-78236929d015 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.136600 Nov 25 08:45:27.903045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 411/832] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:27 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:28.770858 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:28.771927 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:28.781144 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:28.782226 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:28.783717 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:28.784473 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:28.921641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fad2b4b6-4bcc-4e01-894e-8b5748bb528f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:28.924017 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fad2b4b6-4bcc-4e01-894e-8b5748bb528f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:28.937265 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fad2b4b6-4bcc-4e01-894e-8b5748bb528f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:28.938247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fad2b4b6-4bcc-4e01-894e-8b5748bb528f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:28.939837 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fad2b4b6-4bcc-4e01-894e-8b5748bb528f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:28.940969 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fad2b4b6-4bcc-4e01-894e-8b5748bb528f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:28.995893 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:29.009885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-151400a8-5924-4d2d-a0df-b7dd3bd11cc1 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1498 microversion: 2.1 time: 0.245198 Nov 25 08:45:29.011944 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 422/833] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:28 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1498 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:29.020438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fad2b4b6-4bcc-4e01-894e-8b5748bb528f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.109380 Nov 25 08:45:29.021477 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 412/834] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:28 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:29.022590 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:29.026196 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:29.038498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:29.039319 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:29.040873 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:29.047498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:29.086180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1270152699", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe88a060-11d1-49d6-a468-aec69a44188a"}], "security_groups": [{"name": "tempest-securitygroup--806033709"}], "key_name": "tempest-keypair-867805245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:29.511879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] validate_networks() for [('fe88a060-11d1-49d6-a468-aec69a44188a', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:45:29.611259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:29.625271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-766ae7e7-9388-411a-a82f-ffa99db87620 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.611071 Nov 25 08:45:29.626901 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 423/835] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:29 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:29.708864 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:29.710147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:29.723745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:29.725173 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:29.727121 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:29.728169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:29.768096 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:45:29.893312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cfd472cd-b465-46d4-81ac-cdfdee632439 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 204 len: 0 microversion: 2.1 time: 0.192638 Nov 25 08:45:29.895956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 424/836] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:45:29 2021] DELETE /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:45:29.910267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:29.911702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:29.922815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:29.924088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:29.925927 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:29.927218 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:30.391292 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:30.403763 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-16c131c7-a55d-410d-94e1-32444523eb15 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1504 microversion: 2.1 time: 0.501873 Nov 25 08:45:30.405259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 425/837] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:29 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:30.416171 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1e1684fc-3658-4a0f-bedd-a33a5ecd837d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:30.418415 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1e1684fc-3658-4a0f-bedd-a33a5ecd837d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:30.433638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e1684fc-3658-4a0f-bedd-a33a5ecd837d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:30.434808 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e1684fc-3658-4a0f-bedd-a33a5ecd837d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:30.436630 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e1684fc-3658-4a0f-bedd-a33a5ecd837d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:30.438381 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e1684fc-3658-4a0f-bedd-a33a5ecd837d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:30.474149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:45:30.474954 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:45:30.475176 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:45:30.475435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:45:30.475867 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:45:30.495287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:30.495841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:30.497934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:30.498564 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:30.526159 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for project eb52ad5308c241089b4e2e8f09206f74. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:45:30.532700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Getting quotas for user a25f49cbab094baabb82829b4b71a5e7 and project eb52ad5308c241089b4e2e8f09206f74. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:45:30.548971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:45:30.551136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1e1684fc-3658-4a0f-bedd-a33a5ecd837d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.142431 Nov 25 08:45:30.553023 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:45:30.553449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 426/838] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:30 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:30.646459 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d0ebce2e-386b-4f1f-833d-ae19956b6c91 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.564922 Nov 25 08:45:30.652573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 413/839] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:45:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 25 08:45:30.654661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:30.656054 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:30.662821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-af1d1aa7-7bbc-4f13-bc46-97d49413489d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:30.664260 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-af1d1aa7-7bbc-4f13-bc46-97d49413489d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:30.676026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:30.678295 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:30.680180 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:30.681090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:30.826639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-af1d1aa7-7bbc-4f13-bc46-97d49413489d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:30.849969 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-af1d1aa7-7bbc-4f13-bc46-97d49413489d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1237 microversion: 2.1 time: 0.195186 Nov 25 08:45:30.865940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 414/840] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:30 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1237 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:30.996221 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:31.006085 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-767bd384-c67e-4495-9cd9-b0b9e62fb7c2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.357585 Nov 25 08:45:31.007057 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 427/841] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:30 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:31.424911 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:31.425861 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:31.433495 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:31.434153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:31.434944 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:31.435841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:31.565508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ad524278-6eae-4087-914b-1ab6262629ce tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:31.566921 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ad524278-6eae-4087-914b-1ab6262629ce tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:31.576647 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad524278-6eae-4087-914b-1ab6262629ce tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:31.578773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad524278-6eae-4087-914b-1ab6262629ce tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:31.580423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad524278-6eae-4087-914b-1ab6262629ce tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:31.581055 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ad524278-6eae-4087-914b-1ab6262629ce tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:31.609405 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:31.618412 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b3dc4234-1777-4a83-9866-1d1978913e35 tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1504 microversion: 2.1 time: 0.197849 Nov 25 08:45:31.619001 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 415/842] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:31 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:31.698193 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ad524278-6eae-4087-914b-1ab6262629ce tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.134013 Nov 25 08:45:31.698868 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 428/843] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:31 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:31.872798 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:31.873624 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:31.884008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:31.884461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:31.885327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:31.885974 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:31.949391 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:31.958775 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-37b5fb46-c6ca-4931-9b69-94b27b1a0eee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1289 microversion: 2.1 time: 0.089608 Nov 25 08:45:31.959782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 416/844] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:31 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:31.981391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-b4704560-5964-4f6c-b169-6c1749626032 req-05b8dc4a-1b3c-4d49-86d1-8cff2cc7f7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b940ec-da83-47d2-81eb-2b12373a55ae", "name": "network-vif-plugged", "status": "completed", "tag": "a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:31.984539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:31.984539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:31.998601 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-b4704560-5964-4f6c-b169-6c1749626032 req-05b8dc4a-1b3c-4d49-86d1-8cff2cc7f7e2 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:31.999448 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-b4704560-5964-4f6c-b169-6c1749626032 req-05b8dc4a-1b3c-4d49-86d1-8cff2cc7f7e2 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.026422 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:32.027032 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:32.028201 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-b4704560-5964-4f6c-b169-6c1749626032 req-05b8dc4a-1b3c-4d49-86d1-8cff2cc7f7e2 service nova] Creating event network-vif-plugged:a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf for instance d8b940ec-da83-47d2-81eb-2b12373a55ae on hv-cinder-77819 Nov 25 08:45:32.036882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-b4704560-5964-4f6c-b169-6c1749626032 req-05b8dc4a-1b3c-4d49-86d1-8cff2cc7f7e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062868 Nov 25 08:45:32.037646 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 429/845] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:32.050182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.050643 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.051649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.052089 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.337910 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:32.349573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dafca8e2-60f5-4f38-95c5-091b4e4d881c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.328036 Nov 25 08:45:32.361417 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 417/846] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:32 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:32.644076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:32.645708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:32.658232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.659041 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.660543 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.661625 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.715203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d9732e84-6ed3-4e3b-bcec-b8cef4d70b3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:32.720810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d9732e84-6ed3-4e3b-bcec-b8cef4d70b3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:32.756431 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9732e84-6ed3-4e3b-bcec-b8cef4d70b3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.760115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9732e84-6ed3-4e3b-bcec-b8cef4d70b3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.762130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9732e84-6ed3-4e3b-bcec-b8cef4d70b3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.763649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d9732e84-6ed3-4e3b-bcec-b8cef4d70b3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.882103 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d9732e84-6ed3-4e3b-bcec-b8cef4d70b3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.174742 Nov 25 08:45:32.883006 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 418/847] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:32 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:32.978980 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:32.979884 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:32.987778 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.988229 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:32.989298 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:32.989767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:33.177130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:33.185121 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-708af8a7-501a-4527-814b-6e31d30a46f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1295 microversion: 2.1 time: 0.210238 Nov 25 08:45:33.185808 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 419/848] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:32 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:33.228602 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-8a166091-2e18-4044-a7c1-942c8079b3d8 req-069e3d33-5918-4a55-8bf5-67f0798119f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09aa1f4-de4e-4cf5-9816-b9f2f849eca3", "name": "network-vif-deleted", "tag": "a4bd6569-b525-42e6-88d5-9a1331eb2ad1"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:33.231191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:33.231191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:33.243511 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-8a166091-2e18-4044-a7c1-942c8079b3d8 req-069e3d33-5918-4a55-8bf5-67f0798119f7 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:33.244582 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-8a166091-2e18-4044-a7c1-942c8079b3d8 req-069e3d33-5918-4a55-8bf5-67f0798119f7 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:33.270530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-8a166091-2e18-4044-a7c1-942c8079b3d8 req-069e3d33-5918-4a55-8bf5-67f0798119f7 service nova] Creating event network-vif-deleted:a4bd6569-b525-42e6-88d5-9a1331eb2ad1 for instance a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 on hv-cinder-77819 Nov 25 08:45:33.275091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b4fe6fb539453681ca6870f6997ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12215da390b49b9ba3f302c6a19a80a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:33.288835 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-8a166091-2e18-4044-a7c1-942c8079b3d8 req-069e3d33-5918-4a55-8bf5-67f0798119f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064597 Nov 25 08:45:33.290281 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 420/849] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:45:33.290467 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7b19532f-cf07-46d7-ba8a-fd70db2a185e tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 200 len: 1504 microversion: 2.1 time: 0.655528 Nov 25 08:45:33.291524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 430/850] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:32 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 1504 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:33.369537 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:33.370632 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:33.378163 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:33.378603 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:33.379417 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:33.379886 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:33.605354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:33.613849 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-241b6e4d-8434-4255-9d20-6ae45fe8bdeb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1265 microversion: 2.1 time: 0.249136 Nov 25 08:45:33.614429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 421/851] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:33 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:33.898892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-59ce6814-8511-426e-a0bd-8fcdeab77651 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:33.900282 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-59ce6814-8511-426e-a0bd-8fcdeab77651 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:33.908152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59ce6814-8511-426e-a0bd-8fcdeab77651 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:33.908601 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59ce6814-8511-426e-a0bd-8fcdeab77651 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:33.909429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59ce6814-8511-426e-a0bd-8fcdeab77651 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:33.910631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-59ce6814-8511-426e-a0bd-8fcdeab77651 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:34.012609 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-59ce6814-8511-426e-a0bd-8fcdeab77651 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.119601 Nov 25 08:45:34.017042 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 431/852] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:33 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:34.217232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:34.219058 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:34.246054 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:34.247296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:34.248739 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:34.249647 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:34.312998 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:34.314751 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] [instance: a09aa1f4-de4e-4cf5-9816-b9f2f849eca3] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:34.322701 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:34.323183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:34.324131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:34.325131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:34.342395 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] HTTP exception thrown: Instance a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 could not be found. Nov 25 08:45:34.343676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] Returning 404 to user: Instance a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:45:34.344528 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-37e0ff83-e51b-4f2f-89ad-3bf4c742726d tempest-VolumesActionsTest-1103787132 tempest-VolumesActionsTest-1103787132-project] 10.222.0.46 "GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3" status: 404 len: 111 microversion: 2.1 time: 0.036328 Nov 25 08:45:34.345112 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 432/853] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:34 2021] GET /compute/v2.1/servers/a09aa1f4-de4e-4cf5-9816-b9f2f849eca3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:45:34.606863 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:34.617315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d644bc62-1981-4619-a576-20e85ac2ae5a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.406760 Nov 25 08:45:34.618171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 422/854] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:34 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:34.646259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:34.647413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:34.658816 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:34.659953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:34.661969 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:34.662801 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.028580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a9a34849-3e4d-4a8d-88f6-40c2a30c1e80 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:35.031276 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a9a34849-3e4d-4a8d-88f6-40c2a30c1e80 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:35.045517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9a34849-3e4d-4a8d-88f6-40c2a30c1e80 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:35.047310 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9a34849-3e4d-4a8d-88f6-40c2a30c1e80 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.049108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9a34849-3e4d-4a8d-88f6-40c2a30c1e80 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:35.049885 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9a34849-3e4d-4a8d-88f6-40c2a30c1e80 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.088855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:35.105941 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-289c708a-4dc3-429a-ab32-1d3376853d06 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1452 microversion: 2.1 time: 0.468723 Nov 25 08:45:35.107206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 433/855] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:34 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1452 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:35.125953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:35.126946 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:35.134177 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:35.134963 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.135981 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:35.136566 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.158882 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a9a34849-3e4d-4a8d-88f6-40c2a30c1e80 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 14 microversion: 2.20 time: 0.136895 Nov 25 08:45:35.159967 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 423/856] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:35 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:35.557563 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-ee6707ce-05b4-4eca-a57e-375f471a985b req-5fa20120-1ca3-46ad-9033-6857d0a32958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf3f071-40f2-4ec3-a1df-0e78f884f182", "tag": "13716166-79b6-4ab0-86f6-42919899bfee"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:35.559590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:35.559590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:35.568122 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-ee6707ce-05b4-4eca-a57e-375f471a985b req-5fa20120-1ca3-46ad-9033-6857d0a32958 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:35.568422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:35.569127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-ee6707ce-05b4-4eca-a57e-375f471a985b req-5fa20120-1ca3-46ad-9033-6857d0a32958 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.591267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-ee6707ce-05b4-4eca-a57e-375f471a985b req-5fa20120-1ca3-46ad-9033-6857d0a32958 service nova] Creating event network-changed:13716166-79b6-4ab0-86f6-42919899bfee for instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 on hv-cinder-77819 Nov 25 08:45:35.594139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f0c9da06-60e8-4e72-a4b9-0ead8d4581bf tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1452 microversion: 2.1 time: 0.471802 Nov 25 08:45:35.597058 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 434/857] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:35 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1452 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:35.597973 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-ee6707ce-05b4-4eca-a57e-375f471a985b req-5fa20120-1ca3-46ad-9033-6857d0a32958 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046822 Nov 25 08:45:35.598831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 424/858] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:45:35.650468 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:35.651088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:35.665411 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:35.666186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.670318 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:35.674128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:35.899999 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:35.910752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8e136c2d-aa12-48bf-80e0-5b375f2a76c3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.264769 Nov 25 08:45:35.911844 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 435/859] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:35 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:36.179672 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6132fd20-085e-466a-9321-bc7a19928e91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:36.180693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6132fd20-085e-466a-9321-bc7a19928e91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:36.188871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6132fd20-085e-466a-9321-bc7a19928e91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:36.189742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6132fd20-085e-466a-9321-bc7a19928e91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:36.190479 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6132fd20-085e-466a-9321-bc7a19928e91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:36.190889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6132fd20-085e-466a-9321-bc7a19928e91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:37.252582 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:37.254536 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:37.265565 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:37.266460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:37.268116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:37.268847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:37.529646 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:37.549401 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a3fdd80e-e905-4f0a-8381-01f1260dee87 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.615927 Nov 25 08:45:37.550440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 436/860] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:36 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:38.058233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-430c0fd9-8747-4404-86a9-b51fffc13e39 req-48d9ed0f-3702-498c-8e5f-d28d98baffbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b940ec-da83-47d2-81eb-2b12373a55ae", "tag": "a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:38.060373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:38.060373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:38.070525 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-430c0fd9-8747-4404-86a9-b51fffc13e39 req-48d9ed0f-3702-498c-8e5f-d28d98baffbe service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:38.070927 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-430c0fd9-8747-4404-86a9-b51fffc13e39 req-48d9ed0f-3702-498c-8e5f-d28d98baffbe service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:38.087001 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-430c0fd9-8747-4404-86a9-b51fffc13e39 req-48d9ed0f-3702-498c-8e5f-d28d98baffbe service nova] Creating event network-changed:a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf for instance d8b940ec-da83-47d2-81eb-2b12373a55ae on hv-cinder-77819 Nov 25 08:45:38.095151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-430c0fd9-8747-4404-86a9-b51fffc13e39 req-48d9ed0f-3702-498c-8e5f-d28d98baffbe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041649 Nov 25 08:45:38.096126 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 437/861] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:45:38.575734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:38.577594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:38.585458 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:38.586166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:38.587227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:38.587803 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:38.706215 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6132fd20-085e-466a-9321-bc7a19928e91 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 15064 microversion: 2.20 time: 2.539648 Nov 25 08:45:38.711676 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 425/862] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:36 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 15064 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:39.239638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:39.249243 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-51c560f5-7c72-42ca-8d30-d99d7868a163 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.678473 Nov 25 08:45:39.262717 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 438/863] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:38 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:45:39.727783 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e8299e03-495e-4961-adc7-d72e936996a6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:39.733762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e8299e03-495e-4961-adc7-d72e936996a6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:39.744287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8299e03-495e-4961-adc7-d72e936996a6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:39.745118 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8299e03-495e-4961-adc7-d72e936996a6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:39.746389 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8299e03-495e-4961-adc7-d72e936996a6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:39.746817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8299e03-495e-4961-adc7-d72e936996a6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:39.851725 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e8299e03-495e-4961-adc7-d72e936996a6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 18206 microversion: 2.20 time: 0.134255 Nov 25 08:45:39.853764 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 426/864] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:39 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 18206 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:40.277898 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:40.279308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:40.296233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:40.297039 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:40.298241 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:40.299011 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:40.330847 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1284240059", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "174db974-9d6e-4aca-b06c-4c66d94ce421"}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:40.408229 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] validate_networks() for [('174db974-9d6e-4aca-b06c-4c66d94ce421', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:45:40.692850 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:40.702671 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a4714877-e451-47a7-bbff-2583f2984cdf tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.428808 Nov 25 08:45:40.718450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 439/865] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:40 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:40.868107 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0085df2b-db71-48d3-9c9f-5939a900f320 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:40.869049 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0085df2b-db71-48d3-9c9f-5939a900f320 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:40.877349 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0085df2b-db71-48d3-9c9f-5939a900f320 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:40.877800 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0085df2b-db71-48d3-9c9f-5939a900f320 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:40.878603 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0085df2b-db71-48d3-9c9f-5939a900f320 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:40.879227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0085df2b-db71-48d3-9c9f-5939a900f320 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:41.024226 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0085df2b-db71-48d3-9c9f-5939a900f320 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 19342 microversion: 2.20 time: 0.160392 Nov 25 08:45:41.026338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 440/866] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:40 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 19342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:41.224712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:45:41.227627 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:45:41.229491 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:45:41.230715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:45:41.233142 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:45:41.260428 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:41.261914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:41.265658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:41.267133 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:41.312119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Getting quotas for project 3500139a1c5d49a1ae51cf5064532856. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:45:41.323723 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Getting quotas for user d648a8a7abcd43b2a2f32cdbbf296597 and project 3500139a1c5d49a1ae51cf5064532856. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:45:41.353742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:45:41.364781 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:45:41.501250 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8a4d4a30-b63d-4ce0-b621-224ed2c8689b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174808 Nov 25 08:45:41.503720 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 427/867] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:45:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:45:41.530496 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6410ae16-1802-48a5-9aff-1abffed9bb04 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:41.532922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6410ae16-1802-48a5-9aff-1abffed9bb04 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:41.644357 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6410ae16-1802-48a5-9aff-1abffed9bb04 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:41.659867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6410ae16-1802-48a5-9aff-1abffed9bb04 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1219 microversion: 2.1 time: 0.142334 Nov 25 08:45:41.660815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 441/868] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:41 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:41.727891 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:41.728868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:41.751817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:41.753251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:41.755036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:41.755913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:42.040524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:42.041313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9c007e3f-5a4b-4aa1-a073-6532a2a7e70e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:42.042841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9c007e3f-5a4b-4aa1-a073-6532a2a7e70e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:42.063614 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-332ed83b-45c1-4ae8-af64-c8a935f7b2dd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.340838 Nov 25 08:45:42.064706 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 428/869] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:41 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:42.078787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c007e3f-5a4b-4aa1-a073-6532a2a7e70e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:42.080126 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c007e3f-5a4b-4aa1-a073-6532a2a7e70e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:42.081742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c007e3f-5a4b-4aa1-a073-6532a2a7e70e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:42.082638 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9c007e3f-5a4b-4aa1-a073-6532a2a7e70e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:42.181205 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9c007e3f-5a4b-4aa1-a073-6532a2a7e70e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 21834 microversion: 2.20 time: 0.146134 Nov 25 08:45:42.182904 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 442/870] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:42 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 21834 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:42.686605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:42.692407 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:42.716002 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:42.717758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:42.719216 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:42.720100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:42.871293 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:42.888861 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0cccf1f4-6ff9-45c3-898e-910bf9be1fc4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1271 microversion: 2.1 time: 0.210324 Nov 25 08:45:42.891998 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 429/871] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:42 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:43.090500 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:43.096895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:43.127266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:43.128080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:43.129615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:43.130322 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:43.206366 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-751499b8-aa79-4c8a-862b-c56b9b177ee4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:43.209072 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-751499b8-aa79-4c8a-862b-c56b9b177ee4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:43.224231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-751499b8-aa79-4c8a-862b-c56b9b177ee4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:43.225587 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-751499b8-aa79-4c8a-862b-c56b9b177ee4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:43.228075 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-751499b8-aa79-4c8a-862b-c56b9b177ee4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:43.229594 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-751499b8-aa79-4c8a-862b-c56b9b177ee4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:43.344169 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-751499b8-aa79-4c8a-862b-c56b9b177ee4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 23170 microversion: 2.20 time: 0.144588 Nov 25 08:45:43.345223 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 430/872] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:43 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 23170 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:43.456882 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:43.473758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a8c2f54e-cc5f-4099-ba8d-f262b57e7b1e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.390455 Nov 25 08:45:43.475254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 443/873] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:43 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:43.919685 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:43.921334 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:43.935639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:43.937333 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:43.938470 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:43.939611 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:44.093946 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:44.110109 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-37a6bd12-e887-4d88-8449-c90594c6da7f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1277 microversion: 2.1 time: 0.195369 Nov 25 08:45:44.122201 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 431/874] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:43 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:44.371943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-66a3c263-9be5-436c-a4b2-669e2a9c7c26 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:44.380494 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-66a3c263-9be5-436c-a4b2-669e2a9c7c26 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:44.405618 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66a3c263-9be5-436c-a4b2-669e2a9c7c26 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:44.406703 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66a3c263-9be5-436c-a4b2-669e2a9c7c26 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:44.408036 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66a3c263-9be5-436c-a4b2-669e2a9c7c26 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:44.412559 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-66a3c263-9be5-436c-a4b2-669e2a9c7c26 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:44.506928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:44.508555 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:44.528326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:44.529939 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:44.532031 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:44.533106 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:44.595708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-66a3c263-9be5-436c-a4b2-669e2a9c7c26 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 24097 microversion: 2.20 time: 0.237158 Nov 25 08:45:44.601767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 444/875] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:44 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 24097 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:44.888528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:44.902553 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b62aeb71-9aaf-4aeb-8577-49ca96c120f4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.405273 Nov 25 08:45:44.906136 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 432/876] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:44 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:45.141717 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:45.146711 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:45.176038 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:45.181385 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:45.189545 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:45.191175 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:45.619557 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-761016ac-540c-469a-a1f5-254a6ce0d7a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:45.621197 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-761016ac-540c-469a-a1f5-254a6ce0d7a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:45.654065 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-761016ac-540c-469a-a1f5-254a6ce0d7a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:45.655390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-761016ac-540c-469a-a1f5-254a6ce0d7a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:45.657765 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-761016ac-540c-469a-a1f5-254a6ce0d7a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:45.658779 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-761016ac-540c-469a-a1f5-254a6ce0d7a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:45.794277 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-761016ac-540c-469a-a1f5-254a6ce0d7a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 25267 microversion: 2.20 time: 0.185099 Nov 25 08:45:45.799933 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 433/877] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:45 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 25267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:45.901776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:45.931379 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-568c4f68-025b-449a-824e-37b603426070 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1319 microversion: 2.1 time: 0.804344 Nov 25 08:45:45.936798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 445/878] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:45 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:45.955620 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:45.956328 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:45.971798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:45.972443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:45.973149 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:45.973776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:46.149093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-30d599d9-9ce3-4a88-9435-9fb8ff3d44fb req-0930a994-70e7-4d5f-80dd-7d7bc4f8a4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c60725-c104-415f-b7f9-85c3c12c404e", "tag": "0ff26fce-660e-4b5e-a93e-5455cb4c9d10"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:46.153486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:46.153486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:46.171435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-30d599d9-9ce3-4a88-9435-9fb8ff3d44fb req-0930a994-70e7-4d5f-80dd-7d7bc4f8a4ed service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:46.176329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-30d599d9-9ce3-4a88-9435-9fb8ff3d44fb req-0930a994-70e7-4d5f-80dd-7d7bc4f8a4ed service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:46.203334 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-30d599d9-9ce3-4a88-9435-9fb8ff3d44fb req-0930a994-70e7-4d5f-80dd-7d7bc4f8a4ed service nova] Creating event network-changed:0ff26fce-660e-4b5e-a93e-5455cb4c9d10 for instance 18c60725-c104-415f-b7f9-85c3c12c404e on hv-cinder-77819 Nov 25 08:45:46.213251 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-30d599d9-9ce3-4a88-9435-9fb8ff3d44fb req-0930a994-70e7-4d5f-80dd-7d7bc4f8a4ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410601 Nov 25 08:45:46.216462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 434/879] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:46.311319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-3ae81d02-aed8-4ee8-947e-dae9f7db673e req-0bdc088e-5975-4ae5-ace4-13e1667374a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf3f071-40f2-4ec3-a1df-0e78f884f182", "name": "network-vif-plugged", "status": "completed", "tag": "13716166-79b6-4ab0-86f6-42919899bfee"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:46.313247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:46.313247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:45:46.346581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-3ae81d02-aed8-4ee8-947e-dae9f7db673e req-0bdc088e-5975-4ae5-ace4-13e1667374a1 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:46.348310 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-3ae81d02-aed8-4ee8-947e-dae9f7db673e req-0bdc088e-5975-4ae5-ace4-13e1667374a1 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:46.375477 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-3ae81d02-aed8-4ee8-947e-dae9f7db673e req-0bdc088e-5975-4ae5-ace4-13e1667374a1 service nova] Creating event network-vif-plugged:13716166-79b6-4ab0-86f6-42919899bfee for instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 on hv-cinder-77819 Nov 25 08:45:46.393816 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-3ae81d02-aed8-4ee8-947e-dae9f7db673e req-0bdc088e-5975-4ae5-ace4-13e1667374a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087282 Nov 25 08:45:46.396651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 435/880] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:46.546999 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:46.579644 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ab055c40-cdd8-47ab-8944-47e401cc312a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 0.630145 Nov 25 08:45:46.581076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 446/881] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:45 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:46.968726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e605e309-3277-4159-a250-586868f88241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:46.969296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:46.970380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e605e309-3277-4159-a250-586868f88241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:46.970513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:46.978678 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e605e309-3277-4159-a250-586868f88241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:46.979480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e605e309-3277-4159-a250-586868f88241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:46.980411 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e605e309-3277-4159-a250-586868f88241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:46.980633 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:46.981515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:46.981765 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e605e309-3277-4159-a250-586868f88241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:46.983390 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:46.984071 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:47.174956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:47.183734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-709db88b-6a6d-42d1-84cf-bb7159265432 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1319 microversion: 2.1 time: 0.221515 Nov 25 08:45:47.184686 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 447/882] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:46 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:47.273178 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e605e309-3277-4159-a250-586868f88241 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 26576 microversion: 2.20 time: 0.469475 Nov 25 08:45:47.276428 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 436/883] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:46 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 26576 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:47.617630 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:47.618600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:47.626854 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:47.627750 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:47.628829 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:47.629547 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:48.210324 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:48.211772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:48.228826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:48.229513 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:48.235889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:48.237610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:48.619068 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:48.641478 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-598ceb75-8de3-4d3b-9b5f-ffe83391cd16 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1362 microversion: 2.1 time: 1.031777 Nov 25 08:45:48.649845 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 448/884] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:47 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1362 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:48.660459 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-85ef5b1b-0e23-4466-80b6-cb81f9d11925 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:48.662644 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-85ef5b1b-0e23-4466-80b6-cb81f9d11925 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:48.676049 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85ef5b1b-0e23-4466-80b6-cb81f9d11925 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:48.677194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85ef5b1b-0e23-4466-80b6-cb81f9d11925 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:48.678956 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85ef5b1b-0e23-4466-80b6-cb81f9d11925 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:48.679746 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-85ef5b1b-0e23-4466-80b6-cb81f9d11925 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:48.813821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-85ef5b1b-0e23-4466-80b6-cb81f9d11925 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 27187 microversion: 2.20 time: 0.160998 Nov 25 08:45:48.814385 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 449/885] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:48 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 27187 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:48.832566 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:48.846982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ea6e7a09-a4fc-4e7d-ab27-75c072a1dd8a tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1319 microversion: 2.1 time: 0.640342 Nov 25 08:45:48.851635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 437/886] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:48 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1319 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:49.674115 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:49.674895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:49.682964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.683422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:49.684293 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.684737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:49.828784 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cf1dbae1-5666-46b5-b9d6-9f79d9591116 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:49.829922 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cf1dbae1-5666-46b5-b9d6-9f79d9591116 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:49.856427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cf1dbae1-5666-46b5-b9d6-9f79d9591116 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.856427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cf1dbae1-5666-46b5-b9d6-9f79d9591116 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:49.857301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cf1dbae1-5666-46b5-b9d6-9f79d9591116 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.857848 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cf1dbae1-5666-46b5-b9d6-9f79d9591116 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:49.905378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:49.913481 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ebf91f2a-2273-46dd-a086-5ae2626eef45 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1548 microversion: 2.1 time: 0.245590 Nov 25 08:45:49.922572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 450/887] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:49 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:49.927906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:49.928816 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:49.936301 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.937051 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:49.938042 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.938649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:49.963861 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cf1dbae1-5666-46b5-b9d6-9f79d9591116 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 27453 microversion: 2.20 time: 0.140580 Nov 25 08:45:49.966909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 438/888] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:49 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 27453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:49.980617 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-aed9304d-8150-41dc-a9b1-20902c825d5d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:49.981995 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-aed9304d-8150-41dc-a9b1-20902c825d5d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:49.997799 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aed9304d-8150-41dc-a9b1-20902c825d5d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.997799 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aed9304d-8150-41dc-a9b1-20902c825d5d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:49.998243 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aed9304d-8150-41dc-a9b1-20902c825d5d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:49.998787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-aed9304d-8150-41dc-a9b1-20902c825d5d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:50.219336 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-aed9304d-8150-41dc-a9b1-20902c825d5d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248422 Nov 25 08:45:50.221791 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 439/889] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Nov 25 08:45:49 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:50.258166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:50.268062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b44203af-3f89-4040-93fd-167cace92baf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1319 microversion: 2.1 time: 0.352624 Nov 25 08:45:50.277943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 451/890] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:49 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:50.979599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-88dc7c15-4566-4b40-9fbf-c797b1a07d3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:50.980603 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-88dc7c15-4566-4b40-9fbf-c797b1a07d3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:50.994884 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88dc7c15-4566-4b40-9fbf-c797b1a07d3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:50.995700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88dc7c15-4566-4b40-9fbf-c797b1a07d3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:50.996736 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88dc7c15-4566-4b40-9fbf-c797b1a07d3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:50.997390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-88dc7c15-4566-4b40-9fbf-c797b1a07d3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:51.109776 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-88dc7c15-4566-4b40-9fbf-c797b1a07d3f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 27634 microversion: 2.20 time: 0.134648 Nov 25 08:45:51.110464 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 440/891] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:50 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 27634 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:51.288105 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:51.289588 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:51.298900 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:51.299922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:51.301191 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:51.301647 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:51.489247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:51.505531 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-bdacaab6-0cf9-48d8-8a13-fb1770657cf9 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1319 microversion: 2.1 time: 0.221520 Nov 25 08:45:51.520043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 452/892] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:51 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:51.987692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fb921c88-4c7c-4a77-9974-f387bfcfb270 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:51.991205 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fb921c88-4c7c-4a77-9974-f387bfcfb270 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:52.010813 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb921c88-4c7c-4a77-9974-f387bfcfb270 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.012213 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb921c88-4c7c-4a77-9974-f387bfcfb270 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:52.014688 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb921c88-4c7c-4a77-9974-f387bfcfb270 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.015898 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb921c88-4c7c-4a77-9974-f387bfcfb270 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:52.106112 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-4f009c52-f915-4ea4-a6c4-5976562e469a req-c85af266-381e-460f-88c0-8fd3eb84fb47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf3f071-40f2-4ec3-a1df-0e78f884f182", "tag": "13716166-79b6-4ab0-86f6-42919899bfee"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:52.110533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:52.110533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:52.118045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-4f009c52-f915-4ea4-a6c4-5976562e469a req-c85af266-381e-460f-88c0-8fd3eb84fb47 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.118395 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-4f009c52-f915-4ea4-a6c4-5976562e469a req-c85af266-381e-460f-88c0-8fd3eb84fb47 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:52.145530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fb921c88-4c7c-4a77-9974-f387bfcfb270 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.164814 Nov 25 08:45:52.150119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 441/893] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:51 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:45:52.152214 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-4f009c52-f915-4ea4-a6c4-5976562e469a req-c85af266-381e-460f-88c0-8fd3eb84fb47 service nova] Creating event network-changed:13716166-79b6-4ab0-86f6-42919899bfee for instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 on hv-cinder-77819 Nov 25 08:45:52.160037 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-46fd8bbd-dd84-4990-ba9f-15fe77d3368f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:52.161047 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-46fd8bbd-dd84-4990-ba9f-15fe77d3368f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:52.167875 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-4f009c52-f915-4ea4-a6c4-5976562e469a req-c85af266-381e-460f-88c0-8fd3eb84fb47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161281 Nov 25 08:45:52.171395 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-46fd8bbd-dd84-4990-ba9f-15fe77d3368f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.172048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 453/894] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:52.172317 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-46fd8bbd-dd84-4990-ba9f-15fe77d3368f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:52.173143 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-46fd8bbd-dd84-4990-ba9f-15fe77d3368f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.173587 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-46fd8bbd-dd84-4990-ba9f-15fe77d3368f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:52.283671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-46fd8bbd-dd84-4990-ba9f-15fe77d3368f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28179 microversion: 2.20 time: 0.136009 Nov 25 08:45:52.284886 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 442/895] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:52 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:52.346284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-044d2c52-8a1c-4600-a8a9-e94f8b8ee70e req-9192b79f-ed5b-44d7-bee0-8da06b9bba0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c60725-c104-415f-b7f9-85c3c12c404e", "name": "network-vif-plugged", "status": "completed", "tag": "0ff26fce-660e-4b5e-a93e-5455cb4c9d10"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:52.348170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:45:52.348170 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:45:52.362970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-044d2c52-8a1c-4600-a8a9-e94f8b8ee70e req-9192b79f-ed5b-44d7-bee0-8da06b9bba0c service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.365705 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-044d2c52-8a1c-4600-a8a9-e94f8b8ee70e req-9192b79f-ed5b-44d7-bee0-8da06b9bba0c service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:52.415338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-044d2c52-8a1c-4600-a8a9-e94f8b8ee70e req-9192b79f-ed5b-44d7-bee0-8da06b9bba0c service nova] Creating event network-vif-plugged:0ff26fce-660e-4b5e-a93e-5455cb4c9d10 for instance 18c60725-c104-415f-b7f9-85c3c12c404e on hv-cinder-77819 Nov 25 08:45:52.435373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-044d2c52-8a1c-4600-a8a9-e94f8b8ee70e req-9192b79f-ed5b-44d7-bee0-8da06b9bba0c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197693 Nov 25 08:45:52.438279 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 454/896] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:45:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:45:52.531879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:52.532793 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:52.585605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.586812 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:52.588664 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:52.596100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:53.000515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:53.018301 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-07857b5e-f872-4048-9213-1059029e99ae tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1319 microversion: 2.1 time: 0.493089 Nov 25 08:45:53.019382 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 443/897] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:52 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:53.161756 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-bec8909e-1852-48e2-863d-65f18b59a25e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:53.165976 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-bec8909e-1852-48e2-863d-65f18b59a25e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:53.187686 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bec8909e-1852-48e2-863d-65f18b59a25e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:53.188939 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bec8909e-1852-48e2-863d-65f18b59a25e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:53.192330 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bec8909e-1852-48e2-863d-65f18b59a25e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:53.194679 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-bec8909e-1852-48e2-863d-65f18b59a25e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:53.298548 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2452f31e-d1dc-417a-b8e7-23a842141aea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:53.299826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2452f31e-d1dc-417a-b8e7-23a842141aea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:53.305755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-bec8909e-1852-48e2-863d-65f18b59a25e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.151709 Nov 25 08:45:53.308390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2452f31e-d1dc-417a-b8e7-23a842141aea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:53.309081 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2452f31e-d1dc-417a-b8e7-23a842141aea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:53.309773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 455/898] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:53 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:45:53.310053 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2452f31e-d1dc-417a-b8e7-23a842141aea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:53.311195 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2452f31e-d1dc-417a-b8e7-23a842141aea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:53.424068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2452f31e-d1dc-417a-b8e7-23a842141aea tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28179 microversion: 2.20 time: 0.129453 Nov 25 08:45:53.428679 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 444/899] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:53 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:54.045974 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:54.047705 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:54.056440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:54.057352 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:54.058460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:54.059154 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:54.266554 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:54.281146 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f76201d9-16d3-4124-b07f-de77bb9a6480 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1319 microversion: 2.1 time: 0.239873 Nov 25 08:45:54.282480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 456/900] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:54 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:54.317968 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fdc8c011-21a5-495f-b9de-6d60697034b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:54.319056 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fdc8c011-21a5-495f-b9de-6d60697034b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:54.328175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdc8c011-21a5-495f-b9de-6d60697034b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:54.328620 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdc8c011-21a5-495f-b9de-6d60697034b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:54.329431 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdc8c011-21a5-495f-b9de-6d60697034b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:54.329895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdc8c011-21a5-495f-b9de-6d60697034b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:54.416553 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fdc8c011-21a5-495f-b9de-6d60697034b1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.102482 Nov 25 08:45:54.417205 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 445/901] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:54 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:45:54.438906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3cbd8339-6a6a-46cd-8725-2dfd377b68e8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:54.440282 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3cbd8339-6a6a-46cd-8725-2dfd377b68e8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:54.450429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cbd8339-6a6a-46cd-8725-2dfd377b68e8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:54.451914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cbd8339-6a6a-46cd-8725-2dfd377b68e8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:54.453031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cbd8339-6a6a-46cd-8725-2dfd377b68e8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:54.453708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cbd8339-6a6a-46cd-8725-2dfd377b68e8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:54.544475 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3cbd8339-6a6a-46cd-8725-2dfd377b68e8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28179 microversion: 2.20 time: 0.110671 Nov 25 08:45:54.545792 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 457/902] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:54 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:55.312881 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:45:55.314327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:55.324767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:55.326958 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:55.328202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:55.328735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:55.434693 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0bb02c8d-2442-4114-be9a-7016102d4173 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:55.438674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0bb02c8d-2442-4114-be9a-7016102d4173 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:55.449077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0bb02c8d-2442-4114-be9a-7016102d4173 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:55.456086 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0bb02c8d-2442-4114-be9a-7016102d4173 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:55.458694 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0bb02c8d-2442-4114-be9a-7016102d4173 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:55.459839 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0bb02c8d-2442-4114-be9a-7016102d4173 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:55.558979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:45:55.566212 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0bb02c8d-2442-4114-be9a-7016102d4173 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.139802 Nov 25 08:45:55.568360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c23b1d9a-2512-4118-bb1d-073d848b00d6 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1508 microversion: 2.1 time: 0.265079 Nov 25 08:45:55.570828 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 458/903] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:55 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 25 08:45:55.571144 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 446/904] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:45:55 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:45:55.581406 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d4fc16a8-afff-4a9f-966d-366a608364ee tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:55.583896 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d4fc16a8-afff-4a9f-966d-366a608364ee tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:55.598739 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4fc16a8-afff-4a9f-966d-366a608364ee tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:55.599742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4fc16a8-afff-4a9f-966d-366a608364ee tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:55.601581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4fc16a8-afff-4a9f-966d-366a608364ee tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:55.602331 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4fc16a8-afff-4a9f-966d-366a608364ee tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:55.734678 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d4fc16a8-afff-4a9f-966d-366a608364ee tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28303 microversion: 2.20 time: 0.161061 Nov 25 08:45:55.739111 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 459/905] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:55 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:45:56.578422 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-60e954b0-b8d2-412c-841f-dbbc648b47a1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:56.579352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-60e954b0-b8d2-412c-841f-dbbc648b47a1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:56.586048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60e954b0-b8d2-412c-841f-dbbc648b47a1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:56.586515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60e954b0-b8d2-412c-841f-dbbc648b47a1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:56.587325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60e954b0-b8d2-412c-841f-dbbc648b47a1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:56.587949 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60e954b0-b8d2-412c-841f-dbbc648b47a1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:56.714451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-60e954b0-b8d2-412c-841f-dbbc648b47a1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.140660 Nov 25 08:45:56.715094 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 447/906] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:56 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:45:56.750056 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c0f0c246-0904-4230-a597-3568655c4fde tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:56.751266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c0f0c246-0904-4230-a597-3568655c4fde tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:56.759834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c0f0c246-0904-4230-a597-3568655c4fde tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:56.760321 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c0f0c246-0904-4230-a597-3568655c4fde tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:56.760822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c0f0c246-0904-4230-a597-3568655c4fde tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:56.761256 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c0f0c246-0904-4230-a597-3568655c4fde tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:56.861966 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c0f0c246-0904-4230-a597-3568655c4fde tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28469 microversion: 2.20 time: 0.116949 Nov 25 08:45:56.862879 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 460/907] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:56 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28469 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:57.728067 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d4de2538-57fc-40dd-ae3e-1e5a4a2a1d2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:57.729759 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d4de2538-57fc-40dd-ae3e-1e5a4a2a1d2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:57.737775 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4de2538-57fc-40dd-ae3e-1e5a4a2a1d2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:57.738524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4de2538-57fc-40dd-ae3e-1e5a4a2a1d2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:57.739324 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4de2538-57fc-40dd-ae3e-1e5a4a2a1d2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:57.739786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d4de2538-57fc-40dd-ae3e-1e5a4a2a1d2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:57.815284 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d4de2538-57fc-40dd-ae3e-1e5a4a2a1d2c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.091671 Nov 25 08:45:57.816252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 448/908] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:57 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 25 08:45:57.877491 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-43927465-5c5d-4429-838a-2a5e78f8b9a4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:57.878796 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-43927465-5c5d-4429-838a-2a5e78f8b9a4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:57.887370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43927465-5c5d-4429-838a-2a5e78f8b9a4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:57.887954 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43927465-5c5d-4429-838a-2a5e78f8b9a4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:57.889761 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43927465-5c5d-4429-838a-2a5e78f8b9a4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:57.894997 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-43927465-5c5d-4429-838a-2a5e78f8b9a4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:58.074124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-43927465-5c5d-4429-838a-2a5e78f8b9a4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28609 microversion: 2.20 time: 0.200979 Nov 25 08:45:58.076174 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 461/909] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:57 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28609 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:58.837916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4dd10084-eb77-4294-9532-8968506f53d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:58.839046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4dd10084-eb77-4294-9532-8968506f53d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:58.847841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4dd10084-eb77-4294-9532-8968506f53d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:58.848649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4dd10084-eb77-4294-9532-8968506f53d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:58.849544 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4dd10084-eb77-4294-9532-8968506f53d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:58.850061 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4dd10084-eb77-4294-9532-8968506f53d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:58.943517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4dd10084-eb77-4294-9532-8968506f53d5 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.116982 Nov 25 08:45:58.944300 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 449/910] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:58 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:45:59.097303 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c80a5413-5038-4e3d-867a-bd520ab8d6d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:59.099607 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c80a5413-5038-4e3d-867a-bd520ab8d6d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:59.111123 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c80a5413-5038-4e3d-867a-bd520ab8d6d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:59.111924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c80a5413-5038-4e3d-867a-bd520ab8d6d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:59.113030 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c80a5413-5038-4e3d-867a-bd520ab8d6d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:59.113510 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c80a5413-5038-4e3d-867a-bd520ab8d6d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:59.232812 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c80a5413-5038-4e3d-867a-bd520ab8d6d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28636 microversion: 2.20 time: 0.142259 Nov 25 08:45:59.233271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 462/911] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:45:59 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28636 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:45:59.955472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c95be130-4d6e-410e-9124-a67808a6052d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:45:59.957894 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c95be130-4d6e-410e-9124-a67808a6052d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:45:59.970615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c95be130-4d6e-410e-9124-a67808a6052d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:59.972050 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c95be130-4d6e-410e-9124-a67808a6052d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:45:59.974102 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c95be130-4d6e-410e-9124-a67808a6052d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:45:59.975166 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c95be130-4d6e-410e-9124-a67808a6052d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:00.075319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c95be130-4d6e-410e-9124-a67808a6052d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.124189 Nov 25 08:46:00.076192 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 450/912] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:45:59 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:46:00.247005 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-becc9257-abf9-4cbf-8c07-cb2c16cff1d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:00.249078 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-becc9257-abf9-4cbf-8c07-cb2c16cff1d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:00.256495 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-becc9257-abf9-4cbf-8c07-cb2c16cff1d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:00.257223 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-becc9257-abf9-4cbf-8c07-cb2c16cff1d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:00.258016 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-becc9257-abf9-4cbf-8c07-cb2c16cff1d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:00.258755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-becc9257-abf9-4cbf-8c07-cb2c16cff1d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:00.362554 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-becc9257-abf9-4cbf-8c07-cb2c16cff1d8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28636 microversion: 2.20 time: 0.119527 Nov 25 08:46:00.363380 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 463/913] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:00 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:01.088148 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dd5446a2-5dfa-400e-beda-ad7edd5547a7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:01.089155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dd5446a2-5dfa-400e-beda-ad7edd5547a7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:01.096846 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dd5446a2-5dfa-400e-beda-ad7edd5547a7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:01.097296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dd5446a2-5dfa-400e-beda-ad7edd5547a7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:01.098086 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dd5446a2-5dfa-400e-beda-ad7edd5547a7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:01.098515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dd5446a2-5dfa-400e-beda-ad7edd5547a7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:01.177681 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dd5446a2-5dfa-400e-beda-ad7edd5547a7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.093700 Nov 25 08:46:01.178354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 451/914] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:01 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 25 08:46:01.376461 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-abce3177-cc8b-4059-8751-c318363901cb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:01.377449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-abce3177-cc8b-4059-8751-c318363901cb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:01.388532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abce3177-cc8b-4059-8751-c318363901cb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:01.388532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abce3177-cc8b-4059-8751-c318363901cb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:01.390181 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abce3177-cc8b-4059-8751-c318363901cb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:01.390627 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-abce3177-cc8b-4059-8751-c318363901cb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:01.503380 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-abce3177-cc8b-4059-8751-c318363901cb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28636 microversion: 2.20 time: 0.131817 Nov 25 08:46:01.503909 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 464/915] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:01 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28636 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:02.190520 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2c5af182-5576-4740-9893-01665f352e69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:02.191894 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2c5af182-5576-4740-9893-01665f352e69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:02.200101 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2c5af182-5576-4740-9893-01665f352e69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:02.201145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2c5af182-5576-4740-9893-01665f352e69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:02.202022 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2c5af182-5576-4740-9893-01665f352e69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:02.202461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2c5af182-5576-4740-9893-01665f352e69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:02.283475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2c5af182-5576-4740-9893-01665f352e69 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.097921 Nov 25 08:46:02.284163 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 452/916] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:02 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:46:02.517918 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-41992fd2-f260-4203-800c-18b557d64c70 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:02.519293 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-41992fd2-f260-4203-800c-18b557d64c70 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:02.526514 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41992fd2-f260-4203-800c-18b557d64c70 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:02.526961 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41992fd2-f260-4203-800c-18b557d64c70 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:02.527837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41992fd2-f260-4203-800c-18b557d64c70 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:02.528264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-41992fd2-f260-4203-800c-18b557d64c70 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:02.609265 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-41992fd2-f260-4203-800c-18b557d64c70 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28636 microversion: 2.20 time: 0.095628 Nov 25 08:46:02.610449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 465/917] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:02 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:03.294935 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5970bdbf-ff36-4c08-becd-a4d44c16de7c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:03.296230 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5970bdbf-ff36-4c08-becd-a4d44c16de7c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:03.306573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5970bdbf-ff36-4c08-becd-a4d44c16de7c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:03.306573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5970bdbf-ff36-4c08-becd-a4d44c16de7c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:03.306573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5970bdbf-ff36-4c08-becd-a4d44c16de7c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:03.306573 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5970bdbf-ff36-4c08-becd-a4d44c16de7c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:03.377500 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5970bdbf-ff36-4c08-becd-a4d44c16de7c tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.085927 Nov 25 08:46:03.378155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 453/918] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:03 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:46:03.623197 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6ed31e6f-8a9d-4bc0-b5c5-c314169a8f30 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:03.625522 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6ed31e6f-8a9d-4bc0-b5c5-c314169a8f30 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:03.632635 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6ed31e6f-8a9d-4bc0-b5c5-c314169a8f30 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:03.633080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6ed31e6f-8a9d-4bc0-b5c5-c314169a8f30 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:03.633869 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6ed31e6f-8a9d-4bc0-b5c5-c314169a8f30 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:03.634537 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6ed31e6f-8a9d-4bc0-b5c5-c314169a8f30 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:03.715482 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6ed31e6f-8a9d-4bc0-b5c5-c314169a8f30 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28636 microversion: 2.20 time: 0.097096 Nov 25 08:46:03.716734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 466/919] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:03 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:04.389940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c4bce90d-65ba-4b99-8d6b-3f366be45c81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:04.390928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c4bce90d-65ba-4b99-8d6b-3f366be45c81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:04.397951 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c4bce90d-65ba-4b99-8d6b-3f366be45c81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:04.398508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c4bce90d-65ba-4b99-8d6b-3f366be45c81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:04.399296 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c4bce90d-65ba-4b99-8d6b-3f366be45c81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:04.399755 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c4bce90d-65ba-4b99-8d6b-3f366be45c81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:04.492200 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c4bce90d-65ba-4b99-8d6b-3f366be45c81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.107159 Nov 25 08:46:04.493171 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 454/920] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:04 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:46:04.728775 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d79fb254-4d41-42e1-bf2b-9903ca6c1457 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:04.729893 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d79fb254-4d41-42e1-bf2b-9903ca6c1457 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:04.738713 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d79fb254-4d41-42e1-bf2b-9903ca6c1457 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:04.739158 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d79fb254-4d41-42e1-bf2b-9903ca6c1457 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:04.739985 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d79fb254-4d41-42e1-bf2b-9903ca6c1457 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:04.740418 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d79fb254-4d41-42e1-bf2b-9903ca6c1457 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:04.833964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d79fb254-4d41-42e1-bf2b-9903ca6c1457 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 28636 microversion: 2.20 time: 0.109414 Nov 25 08:46:04.834679 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 467/921] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:04 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 28636 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:05.504902 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-140d6f57-7a4c-4775-a015-3d8b26f5f5c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:05.505878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-140d6f57-7a4c-4775-a015-3d8b26f5f5c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:05.513028 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-140d6f57-7a4c-4775-a015-3d8b26f5f5c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:05.513472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-140d6f57-7a4c-4775-a015-3d8b26f5f5c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:05.514278 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-140d6f57-7a4c-4775-a015-3d8b26f5f5c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:05.514707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-140d6f57-7a4c-4775-a015-3d8b26f5f5c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:05.588822 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-140d6f57-7a4c-4775-a015-3d8b26f5f5c2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14 microversion: 2.1 time: 0.087687 Nov 25 08:46:05.589491 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 455/922] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:05 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:46:05.847914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e8fe5c6c-9e71-4813-8611-1ddc3c7896c3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:05.848912 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e8fe5c6c-9e71-4813-8611-1ddc3c7896c3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:05.856026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8fe5c6c-9e71-4813-8611-1ddc3c7896c3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:05.856475 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8fe5c6c-9e71-4813-8611-1ddc3c7896c3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:05.858517 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8fe5c6c-9e71-4813-8611-1ddc3c7896c3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:05.858953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8fe5c6c-9e71-4813-8611-1ddc3c7896c3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:05.977047 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e8fe5c6c-9e71-4813-8611-1ddc3c7896c3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 29345 microversion: 2.20 time: 0.133103 Nov 25 08:46:05.977732 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 468/923] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:05 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 29345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:06.600334 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-12539f31-1bec-44bb-80d5-eeacf42eeb85 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:06.601320 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-12539f31-1bec-44bb-80d5-eeacf42eeb85 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:06.609531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12539f31-1bec-44bb-80d5-eeacf42eeb85 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:06.609979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12539f31-1bec-44bb-80d5-eeacf42eeb85 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:06.610780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12539f31-1bec-44bb-80d5-eeacf42eeb85 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:06.611203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-12539f31-1bec-44bb-80d5-eeacf42eeb85 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:06.729608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-12539f31-1bec-44bb-80d5-eeacf42eeb85 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 1953 microversion: 2.1 time: 0.133075 Nov 25 08:46:06.730741 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 456/924] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:06 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 1953 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:46:06.989540 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-65db4c2b-3ecb-4b68-81f1-c544070d9cd3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:06.990576 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-65db4c2b-3ecb-4b68-81f1-c544070d9cd3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:06.998629 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-65db4c2b-3ecb-4b68-81f1-c544070d9cd3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:06.999084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-65db4c2b-3ecb-4b68-81f1-c544070d9cd3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:06.999952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-65db4c2b-3ecb-4b68-81f1-c544070d9cd3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:07.000393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-65db4c2b-3ecb-4b68-81f1-c544070d9cd3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:07.092631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-65db4c2b-3ecb-4b68-81f1-c544070d9cd3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 30414 microversion: 2.20 time: 0.107113 Nov 25 08:46:07.093535 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 469/925] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:06 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 30414 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:07.741978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d57f067b-e57f-4fb7-823e-3d052d82a416 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:07.743013 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d57f067b-e57f-4fb7-823e-3d052d82a416 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:07.750824 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d57f067b-e57f-4fb7-823e-3d052d82a416 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:07.751264 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d57f067b-e57f-4fb7-823e-3d052d82a416 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:07.752097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d57f067b-e57f-4fb7-823e-3d052d82a416 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:07.752529 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d57f067b-e57f-4fb7-823e-3d052d82a416 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:07.877200 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d57f067b-e57f-4fb7-823e-3d052d82a416 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 8976 microversion: 2.1 time: 0.139122 Nov 25 08:46:07.877868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 457/926] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:07 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 8976 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:46:08.105199 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4254ac4c-0671-4150-9ff9-0c46a6802f57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:08.106185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4254ac4c-0671-4150-9ff9-0c46a6802f57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:08.114020 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4254ac4c-0671-4150-9ff9-0c46a6802f57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:08.114469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4254ac4c-0671-4150-9ff9-0c46a6802f57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:08.115268 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4254ac4c-0671-4150-9ff9-0c46a6802f57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:08.115741 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4254ac4c-0671-4150-9ff9-0c46a6802f57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:08.235605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4254ac4c-0671-4150-9ff9-0c46a6802f57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 31442 microversion: 2.20 time: 0.133967 Nov 25 08:46:08.236561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 470/927] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:08 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 31442 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:08.870113 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-790265520"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:08.870736 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:08.880771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:08.881581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:08.883101 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:08.885048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:08.895857 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2389dc1d-f944-44fd-a455-b0ee75dda2a2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:08.897247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2389dc1d-f944-44fd-a455-b0ee75dda2a2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:08.907141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2389dc1d-f944-44fd-a455-b0ee75dda2a2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:08.907612 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2389dc1d-f944-44fd-a455-b0ee75dda2a2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:08.908552 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2389dc1d-f944-44fd-a455-b0ee75dda2a2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:08.909205 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2389dc1d-f944-44fd-a455-b0ee75dda2a2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:09.023026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2389dc1d-f944-44fd-a455-b0ee75dda2a2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 14443 microversion: 2.1 time: 0.133422 Nov 25 08:46:09.023942 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 471/928] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:08 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 14443 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:09.038411 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.network.security_group_api [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Removing security group 478f8223-2855-4c55-b909-5d1ac5de451b from port 8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d Nov 25 08:46:09.251686 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3ec8503e-44e1-4bc6-a3fa-3f13a9701284 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:09.253698 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3ec8503e-44e1-4bc6-a3fa-3f13a9701284 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:09.263655 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ec8503e-44e1-4bc6-a3fa-3f13a9701284 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:09.264122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ec8503e-44e1-4bc6-a3fa-3f13a9701284 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:09.264937 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ec8503e-44e1-4bc6-a3fa-3f13a9701284 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:09.265374 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3ec8503e-44e1-4bc6-a3fa-3f13a9701284 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:09.372574 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3ec8503e-44e1-4bc6-a3fa-3f13a9701284 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 32468 microversion: 2.20 time: 0.128471 Nov 25 08:46:09.374779 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 472/929] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:09 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 32468 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:09.434127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-836efe21-93c0-413c-ab91-eefeaa9598ac tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/action" status: 202 len: 0 microversion: 2.1 time: 0.568074 Nov 25 08:46:09.434751 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 458/930] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:08 2021] POST /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:09.446697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-28364d39-fb23-41ef-987d-5baa2e60b4ab req-0091c3ee-86e3-4b89-9a7b-13526d776977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a68de2-f145-457b-b76e-393073e149bb", "tag": "8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:09.448901 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:46:09.448901 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:46:09.461684 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-28364d39-fb23-41ef-987d-5baa2e60b4ab req-0091c3ee-86e3-4b89-9a7b-13526d776977 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:09.462133 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-28364d39-fb23-41ef-987d-5baa2e60b4ab req-0091c3ee-86e3-4b89-9a7b-13526d776977 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:09.477205 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-28364d39-fb23-41ef-987d-5baa2e60b4ab req-0091c3ee-86e3-4b89-9a7b-13526d776977 service nova] Creating event network-changed:8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d for instance 91a68de2-f145-457b-b76e-393073e149bb on hv-cinder-77819 Nov 25 08:46:09.485027 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-28364d39-fb23-41ef-987d-5baa2e60b4ab req-0091c3ee-86e3-4b89-9a7b-13526d776977 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043600 Nov 25 08:46:09.486878 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 473/931] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:46:10.037259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dffb704e-2f34-4ba4-8c42-16b4774a4ff4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:10.038891 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dffb704e-2f34-4ba4-8c42-16b4774a4ff4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:10.047123 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dffb704e-2f34-4ba4-8c42-16b4774a4ff4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:10.047889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dffb704e-2f34-4ba4-8c42-16b4774a4ff4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:10.048960 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dffb704e-2f34-4ba4-8c42-16b4774a4ff4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:10.049609 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dffb704e-2f34-4ba4-8c42-16b4774a4ff4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:10.148424 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dffb704e-2f34-4ba4-8c42-16b4774a4ff4 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 16951 microversion: 2.1 time: 0.114872 Nov 25 08:46:10.149610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 459/932] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:10 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 16951 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:10.386848 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3cd09b06-5456-422d-8e6c-f738a005b2d1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:10.388767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3cd09b06-5456-422d-8e6c-f738a005b2d1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:10.395993 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cd09b06-5456-422d-8e6c-f738a005b2d1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:10.396515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cd09b06-5456-422d-8e6c-f738a005b2d1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:10.397323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cd09b06-5456-422d-8e6c-f738a005b2d1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:10.397767 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3cd09b06-5456-422d-8e6c-f738a005b2d1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:10.503407 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3cd09b06-5456-422d-8e6c-f738a005b2d1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 33043 microversion: 2.20 time: 0.120992 Nov 25 08:46:10.504261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 474/933] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:10 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 33043 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:10.843509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:10.844115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:10.846090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-fa9596d3-7d99-46a6-8aa6-9242bacbad68 req-d823f6a7-2df0-44b5-84a1-9b9d845c40ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91a68de2-f145-457b-b76e-393073e149bb", "tag": "8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:10.847546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:46:10.847546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:46:10.851730 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:10.852236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:10.853052 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:10.853490 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:10.857008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-fa9596d3-7d99-46a6-8aa6-9242bacbad68 req-d823f6a7-2df0-44b5-84a1-9b9d845c40ee service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:10.857483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-fa9596d3-7d99-46a6-8aa6-9242bacbad68 req-d823f6a7-2df0-44b5-84a1-9b9d845c40ee service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:10.871036 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-fa9596d3-7d99-46a6-8aa6-9242bacbad68 req-d823f6a7-2df0-44b5-84a1-9b9d845c40ee service nova] Creating event network-changed:8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d for instance 91a68de2-f145-457b-b76e-393073e149bb on hv-cinder-77819 Nov 25 08:46:10.876586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-fa9596d3-7d99-46a6-8aa6-9242bacbad68 req-d823f6a7-2df0-44b5-84a1-9b9d845c40ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 Nov 25 08:46:10.877782 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 475/934] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:46:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:46:10.959516 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lazy-loading 'services' on Instance uuid 91a68de2-f145-457b-b76e-393073e149bb {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:46:11.055977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dc6b508b-5b69-4910-84de-de9cdc0cd673 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments/f346244b-8675-451e-9290-9643b6504838" status: 202 len: 0 microversion: 2.1 time: 0.216406 Nov 25 08:46:11.056817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 460/935] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:46:10 2021] DELETE /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments/f346244b-8675-451e-9290-9643b6504838 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:11.070645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c5965db9-a469-46f3-94e1-0f148aa5ec3a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:11.071759 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c5965db9-a469-46f3-94e1-0f148aa5ec3a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:11.085161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5965db9-a469-46f3-94e1-0f148aa5ec3a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:11.085616 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5965db9-a469-46f3-94e1-0f148aa5ec3a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:11.086981 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5965db9-a469-46f3-94e1-0f148aa5ec3a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:11.087676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5965db9-a469-46f3-94e1-0f148aa5ec3a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:11.140664 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c5965db9-a469-46f3-94e1-0f148aa5ec3a tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076591 Nov 25 08:46:11.141735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 476/936] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:46:11 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:46:11.162152 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-48f8fcf4-87df-4b43-9ed3-8fdddb5652ee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:11.163153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-48f8fcf4-87df-4b43-9ed3-8fdddb5652ee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:11.172134 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-48f8fcf4-87df-4b43-9ed3-8fdddb5652ee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:11.172586 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-48f8fcf4-87df-4b43-9ed3-8fdddb5652ee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:11.173386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-48f8fcf4-87df-4b43-9ed3-8fdddb5652ee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:11.173820 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-48f8fcf4-87df-4b43-9ed3-8fdddb5652ee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:11.294275 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-48f8fcf4-87df-4b43-9ed3-8fdddb5652ee tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 17781 microversion: 2.1 time: 0.136417 Nov 25 08:46:11.295209 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 461/937] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:11 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 17781 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:11.521417 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-865f9c38-5ac5-4972-8586-61cc0cfd414d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:11.523008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-865f9c38-5ac5-4972-8586-61cc0cfd414d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:11.537304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-865f9c38-5ac5-4972-8586-61cc0cfd414d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:11.538237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-865f9c38-5ac5-4972-8586-61cc0cfd414d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:11.539953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-865f9c38-5ac5-4972-8586-61cc0cfd414d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:11.541642 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-865f9c38-5ac5-4972-8586-61cc0cfd414d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:11.637106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-865f9c38-5ac5-4972-8586-61cc0cfd414d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 33418 microversion: 2.20 time: 0.122739 Nov 25 08:46:11.638350 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 477/938] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:11 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 33418 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:12.152962 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2993f865-4389-4c5f-b3f9-dc23ada87eb5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:12.154497 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2993f865-4389-4c5f-b3f9-dc23ada87eb5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:12.163436 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2993f865-4389-4c5f-b3f9-dc23ada87eb5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.163945 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2993f865-4389-4c5f-b3f9-dc23ada87eb5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.164897 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2993f865-4389-4c5f-b3f9-dc23ada87eb5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.165730 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2993f865-4389-4c5f-b3f9-dc23ada87eb5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.199531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2993f865-4389-4c5f-b3f9-dc23ada87eb5 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050429 Nov 25 08:46:12.200160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 462/939] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:46:12 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 25 08:46:12.211736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:12.212307 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:12.219834 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.220279 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.221062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.221493 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.307135 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] HTTP exception thrown: Instance 91a68de2-f145-457b-b76e-393073e149bb is not attached to volume f346244b-8675-451e-9290-9643b6504838 Nov 25 08:46:12.308218 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Returning 404 to user: Instance 91a68de2-f145-457b-b76e-393073e149bb is not attached to volume f346244b-8675-451e-9290-9643b6504838 {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:46:12.309473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b0f8bad9-ce03-4998-96fd-ae743e8fd3f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:12.309729 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fccc3ad2-433d-4997-9eb3-776bc6c4896e tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments/f346244b-8675-451e-9290-9643b6504838" status: 404 len: 154 microversion: 2.1 time: 0.101953 Nov 25 08:46:12.310711 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 478/940] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:46:12 2021] DELETE /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb/os-volume_attachments/f346244b-8675-451e-9290-9643b6504838 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:46:12.310951 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b0f8bad9-ce03-4998-96fd-ae743e8fd3f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:12.321559 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0f8bad9-ce03-4998-96fd-ae743e8fd3f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.322307 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0f8bad9-ce03-4998-96fd-ae743e8fd3f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.323717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0f8bad9-ce03-4998-96fd-ae743e8fd3f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.324697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b0f8bad9-ce03-4998-96fd-ae743e8fd3f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.435602 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b0f8bad9-ce03-4998-96fd-ae743e8fd3f2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 19127 microversion: 2.1 time: 0.132420 Nov 25 08:46:12.436353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 463/941] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:12 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 19127 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:12.650865 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5409d4e5-314b-4ecb-ad79-0c97b1d3e920 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:12.653008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5409d4e5-314b-4ecb-ad79-0c97b1d3e920 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:12.659640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5409d4e5-314b-4ecb-ad79-0c97b1d3e920 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.660082 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5409d4e5-314b-4ecb-ad79-0c97b1d3e920 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.660874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5409d4e5-314b-4ecb-ad79-0c97b1d3e920 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:12.661301 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5409d4e5-314b-4ecb-ad79-0c97b1d3e920 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:12.761473 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5409d4e5-314b-4ecb-ad79-0c97b1d3e920 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 33729 microversion: 2.20 time: 0.114674 Nov 25 08:46:12.762174 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 479/942] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:12 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 33729 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:13.450272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-829de885-9585-40bd-a8eb-6e605ec8d44e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:13.451273 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-829de885-9585-40bd-a8eb-6e605ec8d44e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:13.459459 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-829de885-9585-40bd-a8eb-6e605ec8d44e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.459986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-829de885-9585-40bd-a8eb-6e605ec8d44e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.460799 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-829de885-9585-40bd-a8eb-6e605ec8d44e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.461232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-829de885-9585-40bd-a8eb-6e605ec8d44e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.481333 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:13.482119 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:13.490672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.491134 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.492011 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.492759 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.522373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:46:13.547914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-829de885-9585-40bd-a8eb-6e605ec8d44e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 20991 microversion: 2.1 time: 0.100397 Nov 25 08:46:13.548644 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 464/943] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:13 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 20991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:13.647796 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-362b6ce1-db1c-463c-976b-907bc5d35d98 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 204 len: 0 microversion: 2.1 time: 0.175513 Nov 25 08:46:13.648820 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 480/944] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:46:13 2021] DELETE /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:46:13.662619 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:13.663964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:13.677120 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.677926 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.679319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.680134 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.777644 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a725f8e3-dd81-4cad-b43c-fa01e716996e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:13.779292 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a725f8e3-dd81-4cad-b43c-fa01e716996e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:13.788710 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a725f8e3-dd81-4cad-b43c-fa01e716996e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.789160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a725f8e3-dd81-4cad-b43c-fa01e716996e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.790425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a725f8e3-dd81-4cad-b43c-fa01e716996e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:13.790571 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a725f8e3-dd81-4cad-b43c-fa01e716996e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:13.848932 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:13.856464 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5ced60cd-7848-4741-9014-b7029d15404d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1555 microversion: 2.1 time: 0.201402 Nov 25 08:46:13.857034 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 465/945] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:13 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1555 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:46:13.885904 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a725f8e3-dd81-4cad-b43c-fa01e716996e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 34322 microversion: 2.20 time: 0.114696 Nov 25 08:46:13.886572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 481/946] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:13 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 34322 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:14.559244 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1d86f39e-bc07-4154-895b-caa4b054967d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:14.560233 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1d86f39e-bc07-4154-895b-caa4b054967d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:14.568542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1d86f39e-bc07-4154-895b-caa4b054967d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:14.568962 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1d86f39e-bc07-4154-895b-caa4b054967d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:14.569766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1d86f39e-bc07-4154-895b-caa4b054967d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:14.570202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1d86f39e-bc07-4154-895b-caa4b054967d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:14.669312 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1d86f39e-bc07-4154-895b-caa4b054967d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 22113 microversion: 2.1 time: 0.113492 Nov 25 08:46:14.669867 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 466/947] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:14 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 22113 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:14.876077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:14.876807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:14.884307 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:14.884771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:14.885627 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:14.887277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:14.899996 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-dddc81a0-b5b9-449e-a9a7-09bd70256488 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:14.901099 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-dddc81a0-b5b9-449e-a9a7-09bd70256488 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:14.909288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dddc81a0-b5b9-449e-a9a7-09bd70256488 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:14.909865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dddc81a0-b5b9-449e-a9a7-09bd70256488 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:14.910656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dddc81a0-b5b9-449e-a9a7-09bd70256488 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:14.911085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-dddc81a0-b5b9-449e-a9a7-09bd70256488 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:15.009864 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-dddc81a0-b5b9-449e-a9a7-09bd70256488 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 34994 microversion: 2.20 time: 0.113934 Nov 25 08:46:15.013937 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 467/948] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:14 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 34994 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:15.046713 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:15.054120 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1480f57b-2187-49bf-9a9e-361c1938d24b tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1555 microversion: 2.1 time: 0.183342 Nov 25 08:46:15.054674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 482/949] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:14 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:46:15.681535 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bee58803-6f52-44d0-bd57-238251037a4f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:15.682507 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bee58803-6f52-44d0-bd57-238251037a4f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:15.689396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bee58803-6f52-44d0-bd57-238251037a4f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:15.689836 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bee58803-6f52-44d0-bd57-238251037a4f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:15.690607 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bee58803-6f52-44d0-bd57-238251037a4f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:15.691035 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bee58803-6f52-44d0-bd57-238251037a4f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:15.929603 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bee58803-6f52-44d0-bd57-238251037a4f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 23218 microversion: 2.1 time: 0.251818 Nov 25 08:46:15.930256 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 468/950] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:15 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 23218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:16.021619 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3986d725-9efa-45b7-bd06-715b525ee235 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:16.022615 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3986d725-9efa-45b7-bd06-715b525ee235 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:16.028980 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3986d725-9efa-45b7-bd06-715b525ee235 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:16.029435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3986d725-9efa-45b7-bd06-715b525ee235 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:16.031062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3986d725-9efa-45b7-bd06-715b525ee235 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:16.031522 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3986d725-9efa-45b7-bd06-715b525ee235 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:16.071773 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:16.072581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:16.080612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:16.081063 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:16.081859 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:16.082292 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:16.138625 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3986d725-9efa-45b7-bd06-715b525ee235 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 35590 microversion: 2.20 time: 0.120482 Nov 25 08:46:16.139461 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 483/951] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:16 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 35590 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:16.223095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:16.231918 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4725db81-28ba-426d-a207-c0303afa20ce tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1555 microversion: 2.1 time: 0.164174 Nov 25 08:46:16.232500 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 469/952] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:16 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:46:16.817337 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-93366ba3-3011-4b7b-a6ee-eaa1c1b0016d req-b7e209b3-b197-41ea-8f21-8f9749caea40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91a68de2-f145-457b-b76e-393073e149bb", "name": "network-vif-deleted", "tag": "8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:16.818822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:46:16.818822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:46:16.827511 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-93366ba3-3011-4b7b-a6ee-eaa1c1b0016d req-b7e209b3-b197-41ea-8f21-8f9749caea40 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:16.827979 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-93366ba3-3011-4b7b-a6ee-eaa1c1b0016d req-b7e209b3-b197-41ea-8f21-8f9749caea40 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:16.841452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-93366ba3-3011-4b7b-a6ee-eaa1c1b0016d req-b7e209b3-b197-41ea-8f21-8f9749caea40 service nova] Creating event network-vif-deleted:8b5f1f90-74c8-45b0-a6aa-7c7d40845e4d for instance 91a68de2-f145-457b-b76e-393073e149bb on hv-cinder-77819 Nov 25 08:46:16.847317 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-93366ba3-3011-4b7b-a6ee-eaa1c1b0016d req-b7e209b3-b197-41ea-8f21-8f9749caea40 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Nov 25 08:46:16.847982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 484/953] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:46:16.942509 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c1ec719a-3105-40c8-87e0-a7f54583a002 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:16.943433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c1ec719a-3105-40c8-87e0-a7f54583a002 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:16.950003 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1ec719a-3105-40c8-87e0-a7f54583a002 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:16.950452 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1ec719a-3105-40c8-87e0-a7f54583a002 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:16.951236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1ec719a-3105-40c8-87e0-a7f54583a002 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:16.951709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1ec719a-3105-40c8-87e0-a7f54583a002 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:17.037969 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c1ec719a-3105-40c8-87e0-a7f54583a002 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 23794 microversion: 2.1 time: 0.099031 Nov 25 08:46:17.038504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 470/954] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:16 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 23794 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:17.152271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-eaf32cce-6c90-49a4-91d0-4d46b4faab99 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:17.153268 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-eaf32cce-6c90-49a4-91d0-4d46b4faab99 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:17.160338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eaf32cce-6c90-49a4-91d0-4d46b4faab99 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:17.160765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eaf32cce-6c90-49a4-91d0-4d46b4faab99 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:17.161553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eaf32cce-6c90-49a4-91d0-4d46b4faab99 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:17.161981 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eaf32cce-6c90-49a4-91d0-4d46b4faab99 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:17.250960 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:17.251635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:17.254828 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-eaf32cce-6c90-49a4-91d0-4d46b4faab99 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 36325 microversion: 2.20 time: 0.107807 Nov 25 08:46:17.255486 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 485/955] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:17 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 36325 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:17.259918 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:17.260369 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:17.261182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:17.261620 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:17.295579 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:17.297094 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:17.297291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lazy-loading 'fault' on Instance uuid 91a68de2-f145-457b-b76e-393073e149bb {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:46:17.341779 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fb5977a4a204af69fb9a90930a89457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc4103c9eb443549b5e374c148eae92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:17.350056 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bac40eea-b0bd-43b4-a14f-7dfc83c72f9d tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 200 len: 1348 microversion: 2.1 time: 0.103913 Nov 25 08:46:17.350633 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 471/956] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:17 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:46:18.050089 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-35f91985-0ed8-49bb-bba1-797edc617962 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:18.051079 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-35f91985-0ed8-49bb-bba1-797edc617962 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:18.059845 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35f91985-0ed8-49bb-bba1-797edc617962 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:18.060291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35f91985-0ed8-49bb-bba1-797edc617962 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:18.061613 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35f91985-0ed8-49bb-bba1-797edc617962 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:18.062043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-35f91985-0ed8-49bb-bba1-797edc617962 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:18.150244 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-35f91985-0ed8-49bb-bba1-797edc617962 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 24169 microversion: 2.1 time: 0.103990 Nov 25 08:46:18.150895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 486/957] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:18 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 24169 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:18.267158 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-463e5bfe-8e3f-4fbc-8ef5-08053b281cbe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:18.268078 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-463e5bfe-8e3f-4fbc-8ef5-08053b281cbe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:18.274390 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-463e5bfe-8e3f-4fbc-8ef5-08053b281cbe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:18.274830 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-463e5bfe-8e3f-4fbc-8ef5-08053b281cbe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:18.275655 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-463e5bfe-8e3f-4fbc-8ef5-08053b281cbe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:18.276084 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-463e5bfe-8e3f-4fbc-8ef5-08053b281cbe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:18.368942 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:18.369625 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] [instance: 91a68de2-f145-457b-b76e-393073e149bb] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:18.375666 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-463e5bfe-8e3f-4fbc-8ef5-08053b281cbe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 37253 microversion: 2.20 time: 0.112027 Nov 25 08:46:18.379918 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 472/958] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:18 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 37253 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:18.380088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:18.380088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:18.380088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:18.380088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:18.393542 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] HTTP exception thrown: Instance 91a68de2-f145-457b-b76e-393073e149bb could not be found. Nov 25 08:46:18.394133 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Returning 404 to user: Instance 91a68de2-f145-457b-b76e-393073e149bb could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:46:18.394952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b53e92c0-3fa7-4e0b-9ae0-419fc655ce95 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb" status: 404 len: 111 microversion: 2.1 time: 0.030039 Nov 25 08:46:18.395500 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 487/959] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:18 2021] GET /compute/v2.1/servers/91a68de2-f145-457b-b76e-393073e149bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:46:18.404746 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-05891eff-e17a-4e18-b070-79678f7025c4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] Calling method '.version_select at 0x7f970843f670>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:18.425272 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-05891eff-e17a-4e18-b070-79678f7025c4 tempest-TestMinimumBasicScenario-198484352 tempest-TestMinimumBasicScenario-198484352-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1151699040" status: 202 len: 0 microversion: 2.1 time: 0.024620 Nov 25 08:46:18.425853 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 473/960] 10.222.0.46 () {58 vars in 1271 bytes} [Thu Nov 25 08:46:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1151699040 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:19.162491 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-9e56edbb-b315-450c-9eee-d4e4103d34ae tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:19.163539 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-9e56edbb-b315-450c-9eee-d4e4103d34ae tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:19.170136 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e56edbb-b315-450c-9eee-d4e4103d34ae tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:19.171254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e56edbb-b315-450c-9eee-d4e4103d34ae tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:19.172649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e56edbb-b315-450c-9eee-d4e4103d34ae tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:19.172649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-9e56edbb-b315-450c-9eee-d4e4103d34ae tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:19.258145 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-9e56edbb-b315-450c-9eee-d4e4103d34ae tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 25139 microversion: 2.1 time: 0.099112 Nov 25 08:46:19.258819 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 488/961] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:19 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 25139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:19.388367 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8d3d961d-9731-4743-ad45-077791adc343 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:19.390201 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8d3d961d-9731-4743-ad45-077791adc343 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:19.400260 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d3d961d-9731-4743-ad45-077791adc343 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:19.401098 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d3d961d-9731-4743-ad45-077791adc343 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:19.402754 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d3d961d-9731-4743-ad45-077791adc343 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:19.403669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8d3d961d-9731-4743-ad45-077791adc343 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:19.415043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-aca07c8a-f800-4f00-8a83-adf2418ec3e7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72d36354-d0b0-41a9-88a9-c00edd833343", "device": "/dev/sdb"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:19.417591 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-aca07c8a-f800-4f00-8a83-adf2418ec3e7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:19.426336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aca07c8a-f800-4f00-8a83-adf2418ec3e7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:19.426771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aca07c8a-f800-4f00-8a83-adf2418ec3e7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:19.428391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aca07c8a-f800-4f00-8a83-adf2418ec3e7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:19.428391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aca07c8a-f800-4f00-8a83-adf2418ec3e7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:19.496324 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8d3d961d-9731-4743-ad45-077791adc343 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 37995 microversion: 2.20 time: 0.111804 Nov 25 08:46:19.498158 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 474/962] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:19 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 37995 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:19.713398 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-aca07c8a-f800-4f00-8a83-adf2418ec3e7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "POST /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303358 Nov 25 08:46:19.714277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 489/963] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:46:19 2021] POST /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:46:20.271544 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9480373c-217c-4a10-a5cc-b696a45f9303 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:20.272467 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9480373c-217c-4a10-a5cc-b696a45f9303 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:20.281041 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9480373c-217c-4a10-a5cc-b696a45f9303 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:20.281487 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9480373c-217c-4a10-a5cc-b696a45f9303 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:20.282285 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9480373c-217c-4a10-a5cc-b696a45f9303 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:20.282720 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9480373c-217c-4a10-a5cc-b696a45f9303 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:20.364808 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9480373c-217c-4a10-a5cc-b696a45f9303 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 26260 microversion: 2.1 time: 0.097265 Nov 25 08:46:20.367435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 475/964] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:20 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 26260 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:20.510883 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-da2d8d1a-ed07-4132-b034-932ca7e90411 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:20.512099 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-da2d8d1a-ed07-4132-b034-932ca7e90411 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:20.520206 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da2d8d1a-ed07-4132-b034-932ca7e90411 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:20.520652 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da2d8d1a-ed07-4132-b034-932ca7e90411 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:20.521443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da2d8d1a-ed07-4132-b034-932ca7e90411 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:20.521876 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-da2d8d1a-ed07-4132-b034-932ca7e90411 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:20.611029 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-da2d8d1a-ed07-4132-b034-932ca7e90411 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 38177 microversion: 2.20 time: 0.104142 Nov 25 08:46:20.615432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 490/965] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:20 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 38177 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:21.385244 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-86922847-f386-4f98-8f8f-2e40a456d534 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:21.388508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-86922847-f386-4f98-8f8f-2e40a456d534 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:21.399160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86922847-f386-4f98-8f8f-2e40a456d534 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:21.400145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86922847-f386-4f98-8f8f-2e40a456d534 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:21.401170 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86922847-f386-4f98-8f8f-2e40a456d534 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:21.401709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86922847-f386-4f98-8f8f-2e40a456d534 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:21.494978 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-86922847-f386-4f98-8f8f-2e40a456d534 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 27234 microversion: 2.1 time: 0.120799 Nov 25 08:46:21.499649 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 476/966] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:21 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 27234 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:21.622702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c9a48758-9016-412e-ad6f-956c10f14506 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:21.624208 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c9a48758-9016-412e-ad6f-956c10f14506 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:21.633277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9a48758-9016-412e-ad6f-956c10f14506 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:21.633723 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9a48758-9016-412e-ad6f-956c10f14506 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:21.634601 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9a48758-9016-412e-ad6f-956c10f14506 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:21.635028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c9a48758-9016-412e-ad6f-956c10f14506 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:21.926025 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c9a48758-9016-412e-ad6f-956c10f14506 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 200 len: 38318 microversion: 2.20 time: 0.306967 Nov 25 08:46:21.927338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 491/967] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:21 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 38318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:46:21.938126 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-de6e0e7d-2b98-439b-af32-59847bfc8cd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:21.939281 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-de6e0e7d-2b98-439b-af32-59847bfc8cd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:21.945840 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de6e0e7d-2b98-439b-af32-59847bfc8cd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:21.946388 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de6e0e7d-2b98-439b-af32-59847bfc8cd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:21.947245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de6e0e7d-2b98-439b-af32-59847bfc8cd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:21.947778 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-de6e0e7d-2b98-439b-af32-59847bfc8cd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:21.974878 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-de6e0e7d-2b98-439b-af32-59847bfc8cd2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/ips" status: 200 len: 150 microversion: 2.20 time: 0.041069 Nov 25 08:46:21.975584 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 477/968] 10.222.0.46 () {60 vars in 1288 bytes} [Thu Nov 25 08:46:21 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:22.507800 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f51d8222-7cfa-4258-a155-99de36ed5a8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:22.509038 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f51d8222-7cfa-4258-a155-99de36ed5a8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:22.516922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f51d8222-7cfa-4258-a155-99de36ed5a8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:22.517488 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f51d8222-7cfa-4258-a155-99de36ed5a8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:22.518516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f51d8222-7cfa-4258-a155-99de36ed5a8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:22.518976 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f51d8222-7cfa-4258-a155-99de36ed5a8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:22.612116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f51d8222-7cfa-4258-a155-99de36ed5a8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 27746 microversion: 2.1 time: 0.108148 Nov 25 08:46:22.612773 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 492/969] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:22 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 27746 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:23.625382 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4927850f-807c-42a8-92bf-bac506cf5c6b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:23.626545 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4927850f-807c-42a8-92bf-bac506cf5c6b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:23.634640 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4927850f-807c-42a8-92bf-bac506cf5c6b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:23.635100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4927850f-807c-42a8-92bf-bac506cf5c6b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:23.636037 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4927850f-807c-42a8-92bf-bac506cf5c6b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:23.636472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4927850f-807c-42a8-92bf-bac506cf5c6b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:23.720298 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4927850f-807c-42a8-92bf-bac506cf5c6b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28101 microversion: 2.1 time: 0.098369 Nov 25 08:46:23.723209 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 478/970] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:23 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28101 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:24.110084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:24.111249 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:24.120897 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:24.121639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:24.122651 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:24.123129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:24.151807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lazy-loading 'flavor' on Instance uuid bf899124-0fb5-489e-a87e-f94a838091d7 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:46:24.452289 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-488b664c-8c79-4492-899c-7a5ee03091ec tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 202 len: 0 microversion: 2.20 time: 0.349681 Nov 25 08:46:24.453074 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 493/971] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:46:24 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:46:24.463383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:24.464155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:24.475647 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:24.477181 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:24.478371 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:24.478884 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:24.735860 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-588a90fb-96c4-4a7d-b5d1-c895844fd9d3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:24.737195 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-588a90fb-96c4-4a7d-b5d1-c895844fd9d3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:24.745581 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-588a90fb-96c4-4a7d-b5d1-c895844fd9d3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:24.746112 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-588a90fb-96c4-4a7d-b5d1-c895844fd9d3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:24.747232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-588a90fb-96c4-4a7d-b5d1-c895844fd9d3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:24.747879 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-588a90fb-96c4-4a7d-b5d1-c895844fd9d3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:24.762610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:24.774909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:24.776844 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:24.778195 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4ce8c83f-ddc1-4b84-abe7-509effe6c10c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.318983 Nov 25 08:46:24.778963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 479/972] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:24 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:24.843091 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-588a90fb-96c4-4a7d-b5d1-c895844fd9d3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28228 microversion: 2.1 time: 0.112155 Nov 25 08:46:24.844122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 494/973] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:24 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28228 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:25.808601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:25.810043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:25.821074 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:25.821801 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:25.823391 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:25.824637 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:25.856084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d7aa82d0-79da-4527-a827-bc5665988a52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:25.857092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d7aa82d0-79da-4527-a827-bc5665988a52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:25.864837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7aa82d0-79da-4527-a827-bc5665988a52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:25.865270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7aa82d0-79da-4527-a827-bc5665988a52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:25.866079 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7aa82d0-79da-4527-a827-bc5665988a52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:25.866521 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d7aa82d0-79da-4527-a827-bc5665988a52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:25.942652 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d7aa82d0-79da-4527-a827-bc5665988a52 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28228 microversion: 2.1 time: 0.089834 Nov 25 08:46:25.943926 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 495/974] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:25 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:26.007231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:26.021165 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:26.023708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:26.025815 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5ad61a3f-031e-4973-a268-2f061d7a1fb8 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.220822 Nov 25 08:46:26.026691 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 480/975] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:25 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:26.958264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-40c05054-1f06-4912-b057-5723a06dd41d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:26.959991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-40c05054-1f06-4912-b057-5723a06dd41d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:26.969766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40c05054-1f06-4912-b057-5723a06dd41d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:26.971026 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40c05054-1f06-4912-b057-5723a06dd41d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:26.973116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40c05054-1f06-4912-b057-5723a06dd41d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:26.974076 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-40c05054-1f06-4912-b057-5723a06dd41d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:27.058851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:27.059890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:27.076703 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:27.078243 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:27.078243 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:27.078620 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:27.085007 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-40c05054-1f06-4912-b057-5723a06dd41d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28519 microversion: 2.1 time: 0.131077 Nov 25 08:46:27.086485 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 496/976] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:26 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28519 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:27.261556 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:27.272028 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:27.273448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:27.274646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-02da0cd9-c3e5-45cf-b443-3a76b92554b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.222517 Nov 25 08:46:27.275236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 481/977] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:27 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:28.097765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-dc85f58c-3bc0-442e-860c-45973a8a9f04 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:28.100098 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-dc85f58c-3bc0-442e-860c-45973a8a9f04 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:28.106621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dc85f58c-3bc0-442e-860c-45973a8a9f04 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:28.106621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dc85f58c-3bc0-442e-860c-45973a8a9f04 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:28.107193 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dc85f58c-3bc0-442e-860c-45973a8a9f04 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:28.107865 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dc85f58c-3bc0-442e-860c-45973a8a9f04 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:28.295290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:28.296375 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:28.303503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:28.303979 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:28.304815 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:28.305405 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:28.474266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:28.485120 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:28.486707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:28.487960 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e8f98e55-c5e3-41ea-a56c-04b0ca00b214 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.197309 Nov 25 08:46:28.488531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 482/978] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:28 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:29.507052 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:29.507868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:29.514843 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:29.515298 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:29.516126 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:29.516572 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:29.658731 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:29.666591 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:29.668106 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:29.669380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6e7c9912-a270-4d9f-bee2-dfda9fc6ab15 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.165980 Nov 25 08:46:29.669970 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 483/979] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:29 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:30.688006 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:30.688692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:30.696232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:30.696706 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:30.697503 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:30.698031 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:30.723586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-dc85f58c-3bc0-442e-860c-45973a8a9f04 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28687 microversion: 2.1 time: 2.629141 Nov 25 08:46:30.725137 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 497/980] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:28 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28687 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:30.947460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:30.956856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:30.958335 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:30.959534 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9f521bd6-27c6-4d6f-8a60-d7e7a8438aa6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.275671 Nov 25 08:46:30.960393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 484/981] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:30 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:31.741092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cc6efc7c-d160-4200-90a8-eb753510c2d7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:31.742244 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cc6efc7c-d160-4200-90a8-eb753510c2d7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:31.755936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc6efc7c-d160-4200-90a8-eb753510c2d7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:31.756909 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc6efc7c-d160-4200-90a8-eb753510c2d7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:31.757930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc6efc7c-d160-4200-90a8-eb753510c2d7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:31.758905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc6efc7c-d160-4200-90a8-eb753510c2d7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:31.847439 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cc6efc7c-d160-4200-90a8-eb753510c2d7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28687 microversion: 2.1 time: 0.112510 Nov 25 08:46:31.848810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 498/982] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:31 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28687 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:31.978468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:31.979109 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:31.987294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:31.987783 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:31.988587 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:31.989020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:32.151416 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:32.166157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:32.169180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:32.172146 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-57d20437-791a-4d8e-8302-8d3f34e541d3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.197132 Nov 25 08:46:32.173134 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 485/983] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:31 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:32.860147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1bae2bd7-fb0f-4cda-8177-0fb17d01f526 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:32.861193 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1bae2bd7-fb0f-4cda-8177-0fb17d01f526 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:32.868649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bae2bd7-fb0f-4cda-8177-0fb17d01f526 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:32.869096 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bae2bd7-fb0f-4cda-8177-0fb17d01f526 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:32.869877 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bae2bd7-fb0f-4cda-8177-0fb17d01f526 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:32.870312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1bae2bd7-fb0f-4cda-8177-0fb17d01f526 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:33.195267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:33.196434 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:33.208258 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:33.209019 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:33.210429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:33.211217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:33.369253 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:33.381934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:33.384865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:33.387021 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-95e1df19-e024-4bfe-9791-cddee635e53c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.198355 Nov 25 08:46:33.388107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 486/984] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:33 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:34.416393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:34.417467 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:34.424444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:34.424890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:34.425822 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:34.426255 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:34.569433 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:34.578368 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:34.579904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:34.581057 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-69f1dcd3-a72b-423b-be29-52faa09e5dc2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.168534 Nov 25 08:46:34.581603 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 487/985] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:34 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:35.070807 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1bae2bd7-fb0f-4cda-8177-0fb17d01f526 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28687 microversion: 2.1 time: 2.214719 Nov 25 08:46:35.071462 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 499/986] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:32 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28687 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:35.599906 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:35.600454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:35.607712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:35.608181 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:35.609217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:35.609656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:35.750231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:35.758297 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:35.759917 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:35.761088 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2ccc3c9d-5c5a-49da-88a1-08d0d279880b tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.165015 Nov 25 08:46:35.761663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 488/987] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:35 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:36.083413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b52010c3-64c4-424d-bdbf-8dc50bbdbc13 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:36.084662 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b52010c3-64c4-424d-bdbf-8dc50bbdbc13 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:36.093435 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b52010c3-64c4-424d-bdbf-8dc50bbdbc13 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:36.093957 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b52010c3-64c4-424d-bdbf-8dc50bbdbc13 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:36.094784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b52010c3-64c4-424d-bdbf-8dc50bbdbc13 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:36.095223 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b52010c3-64c4-424d-bdbf-8dc50bbdbc13 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:36.170887 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b52010c3-64c4-424d-bdbf-8dc50bbdbc13 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28687 microversion: 2.1 time: 0.091774 Nov 25 08:46:36.171547 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 500/988] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:36 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28687 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:36.780540 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:36.781155 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:36.787766 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:36.788217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:36.789020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:36.789460 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:36.941362 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:36.957484 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:36.960419 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:36.962641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d88460b4-12cd-45e8-b0bc-3618021f98dc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.186020 Nov 25 08:46:36.963709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 489/989] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:36 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:37.183510 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e8bbf664-1d7c-47bd-8c3f-06c17c5225f1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:37.184532 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e8bbf664-1d7c-47bd-8c3f-06c17c5225f1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:37.192648 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8bbf664-1d7c-47bd-8c3f-06c17c5225f1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:37.193088 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8bbf664-1d7c-47bd-8c3f-06c17c5225f1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:37.193881 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8bbf664-1d7c-47bd-8c3f-06c17c5225f1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:37.194307 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e8bbf664-1d7c-47bd-8c3f-06c17c5225f1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:37.983315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:37.984076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:37.990710 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:37.991146 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:37.991971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:37.992563 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:38.133803 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:38.142231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:38.143749 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:38.144934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2b2b4dab-d6cb-4b2c-b9a5-fd8241ddc035 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.166211 Nov 25 08:46:38.145542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 490/990] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:37 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:39.164468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:39.165198 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:39.172427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:39.172876 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:39.173677 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:39.174108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:39.251715 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e8bbf664-1d7c-47bd-8c3f-06c17c5225f1 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28687 microversion: 2.1 time: 2.071211 Nov 25 08:46:39.253894 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 501/991] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:37 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28687 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:39.331328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:39.343101 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:39.344714 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:39.345950 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-260ec511-0a73-42e1-9954-f53414791522 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.185515 Nov 25 08:46:39.346569 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 491/992] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:39 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:40.269403 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f38dccd8-64d2-4714-bcef-42ba8b80df99 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:40.270457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f38dccd8-64d2-4714-bcef-42ba8b80df99 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:40.279422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f38dccd8-64d2-4714-bcef-42ba8b80df99 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:40.279905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f38dccd8-64d2-4714-bcef-42ba8b80df99 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:40.280714 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f38dccd8-64d2-4714-bcef-42ba8b80df99 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:40.281151 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f38dccd8-64d2-4714-bcef-42ba8b80df99 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:40.366712 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:40.368129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:40.380257 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:40.381044 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:40.382454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:40.383238 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:40.387818 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f38dccd8-64d2-4714-bcef-42ba8b80df99 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28687 microversion: 2.1 time: 0.124949 Nov 25 08:46:40.389300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 502/993] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:40 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28687 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:40.593671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:40.602247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:40.603814 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:40.605049 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cff854d4-26b7-4592-8053-431467a09640 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.243947 Nov 25 08:46:40.605628 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 492/994] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:40 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:41.403633 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fa97826e-31a5-4b41-948c-fb0b26b5dfc2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:41.405505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fa97826e-31a5-4b41-948c-fb0b26b5dfc2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:41.416697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa97826e-31a5-4b41-948c-fb0b26b5dfc2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:41.417416 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa97826e-31a5-4b41-948c-fb0b26b5dfc2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:41.418784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa97826e-31a5-4b41-948c-fb0b26b5dfc2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:41.419713 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa97826e-31a5-4b41-948c-fb0b26b5dfc2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:41.505795 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fa97826e-31a5-4b41-948c-fb0b26b5dfc2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 28687 microversion: 2.1 time: 0.107031 Nov 25 08:46:41.506480 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 503/995] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:41 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 28687 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:41.626000 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:41.626797 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:41.633750 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:41.634095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:41.634909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:41.635346 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:41.792536 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:41.801463 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:41.802977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:41.804249 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1376e9d8-7bd6-4c48-ba3d-9a20df89a39c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1743 microversion: 2.20 time: 0.182803 Nov 25 08:46:41.804820 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 493/996] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:41 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:42.519841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fd4b5ce7-8dcb-4595-8966-3d8fd5af68f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:42.521063 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fd4b5ce7-8dcb-4595-8966-3d8fd5af68f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:42.529556 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd4b5ce7-8dcb-4595-8966-3d8fd5af68f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:42.530277 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd4b5ce7-8dcb-4595-8966-3d8fd5af68f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:42.530867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd4b5ce7-8dcb-4595-8966-3d8fd5af68f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:42.531295 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fd4b5ce7-8dcb-4595-8966-3d8fd5af68f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:42.639905 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fd4b5ce7-8dcb-4595-8966-3d8fd5af68f3 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 29653 microversion: 2.1 time: 0.124642 Nov 25 08:46:42.641203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 504/997] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:42 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 29653 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:42.826571 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:42.827546 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:42.834160 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:42.834656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:42.835523 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:42.836069 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:43.257916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:43.267821 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:43.269315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:43.270505 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-80bb2194-e724-4512-a98a-339b40e25cb3 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1743 microversion: 2.20 time: 0.449042 Nov 25 08:46:43.271140 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 494/998] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:42 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1743 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:43.655485 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-11c5d5a5-5933-4a96-a1e9-6d6325e820bb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:43.656989 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-11c5d5a5-5933-4a96-a1e9-6d6325e820bb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:43.665780 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11c5d5a5-5933-4a96-a1e9-6d6325e820bb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:43.666308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11c5d5a5-5933-4a96-a1e9-6d6325e820bb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:43.667228 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11c5d5a5-5933-4a96-a1e9-6d6325e820bb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:43.667836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-11c5d5a5-5933-4a96-a1e9-6d6325e820bb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:43.708100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:43.709323 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:43.719145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:43.719715 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:43.720646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:43.721357 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:43.789431 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-11c5d5a5-5933-4a96-a1e9-6d6325e820bb tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 30986 microversion: 2.1 time: 0.138220 Nov 25 08:46:43.790267 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 505/999] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:43 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 30986 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 25 08:46:43.850910 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lazy-loading 'services' on Instance uuid 18c60725-c104-415f-b7f9-85c3c12c404e {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:46:43.951955 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bdc10432-17c1-4c7d-9f59-abade75fb8d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "DELETE /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e/os-volume_attachments/72d36354-d0b0-41a9-88a9-c00edd833343" status: 202 len: 0 microversion: 2.1 time: 0.247870 Nov 25 08:46:43.952671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 495/1000] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:46:43 2021] DELETE /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e/os-volume_attachments/72d36354-d0b0-41a9-88a9-c00edd833343 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:46:44.302502 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:44.304186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:44.318012 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:44.318849 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:44.320533 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:44.321700 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:44.535028 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-54eaa83f-762a-4eea-bbed-badbc72d0e12 req-337de677-84f8-4ebb-91d7-8a16c355d9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf899124-0fb5-489e-a87e-f94a838091d7", "name": "network-vif-plugged", "status": "completed", "tag": "358bd9c3-fe7c-46ac-9c3c-82e4369e8f66"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:44.537178 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:46:44.537178 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:46:44.551504 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-54eaa83f-762a-4eea-bbed-badbc72d0e12 req-337de677-84f8-4ebb-91d7-8a16c355d9e8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:44.552851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-54eaa83f-762a-4eea-bbed-badbc72d0e12 req-337de677-84f8-4ebb-91d7-8a16c355d9e8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:44.565028 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-54eaa83f-762a-4eea-bbed-badbc72d0e12 req-337de677-84f8-4ebb-91d7-8a16c355d9e8 service nova] Creating event network-vif-plugged:358bd9c3-fe7c-46ac-9c3c-82e4369e8f66 for instance bf899124-0fb5-489e-a87e-f94a838091d7 on hv-cinder-77819 Nov 25 08:46:44.570610 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-54eaa83f-762a-4eea-bbed-badbc72d0e12 req-337de677-84f8-4ebb-91d7-8a16c355d9e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041113 Nov 25 08:46:44.571860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 496/1001] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:46:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:46:44.576160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:44.587272 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:44.589227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:44.593469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-55b5b345-924c-4a85-9686-71e13c171a57 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.298545 Nov 25 08:46:44.608412 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 506/1002] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:44 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:44.808612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bded4988-21bd-4358-8f29-90dc74ea5692 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:44.815720 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bded4988-21bd-4358-8f29-90dc74ea5692 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:44.839940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bded4988-21bd-4358-8f29-90dc74ea5692 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:44.840562 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bded4988-21bd-4358-8f29-90dc74ea5692 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:44.842646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bded4988-21bd-4358-8f29-90dc74ea5692 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:44.843425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bded4988-21bd-4358-8f29-90dc74ea5692 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:44.968494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bded4988-21bd-4358-8f29-90dc74ea5692 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 32543 microversion: 2.1 time: 0.167701 Nov 25 08:46:44.976820 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 497/1003] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:44 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 32543 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:45.121650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:45.123595 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:45.136605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:45.137123 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:45.138792 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:45.139374 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:45.179504 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:46:45.289913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a44a66ac-e654-42a4-bba1-a4fe8cd57459 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "DELETE /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 204 len: 0 microversion: 2.1 time: 0.171834 Nov 25 08:46:45.291414 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 507/1004] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:46:45 2021] DELETE /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 25 08:46:45.305983 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:45.308098 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:45.319493 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:45.320240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:45.321247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:45.321857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:45.512077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:45.524055 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-84aa7ce6-52c0-4481-be22-8ad7be774c69 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1514 microversion: 2.1 time: 0.225172 Nov 25 08:46:45.524980 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 498/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:45 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:46:45.618010 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:45.619735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:45.636430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:45.637304 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:45.638848 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:45.640982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:45.839793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:45.849006 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:45.850529 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:45.851763 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c034f959-db4d-4d5d-91a8-6cea602a9cf5 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.241631 Nov 25 08:46:45.865457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 508/1006] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:45 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:45.988582 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6214ecd9-8727-49bd-8f32-6996d597d723 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:45.989683 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6214ecd9-8727-49bd-8f32-6996d597d723 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:45.997717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6214ecd9-8727-49bd-8f32-6996d597d723 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:45.998549 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6214ecd9-8727-49bd-8f32-6996d597d723 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:45.999515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6214ecd9-8727-49bd-8f32-6996d597d723 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:46.000050 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6214ecd9-8727-49bd-8f32-6996d597d723 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:46.093787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6214ecd9-8727-49bd-8f32-6996d597d723 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 33342 microversion: 2.1 time: 0.108685 Nov 25 08:46:46.094971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 499/1007] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:45 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 33342 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:46.542708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:46.543618 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:46.551056 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:46.552540 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:46.553708 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:46.554372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:46.718358 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:46.727261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-fa530192-4f72-445e-a9b5-85210cf96a24 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1514 microversion: 2.1 time: 0.188730 Nov 25 08:46:46.728103 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 509/1008] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:46 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:46:46.875010 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:46.876103 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:46.883424 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:46.884202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:46.885210 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:46.885845 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:47.070357 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:47.080664 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:47.082198 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:47.083440 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-66048309-956f-4940-a9a4-3121333b4250 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.214155 Nov 25 08:46:47.084054 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 500/1009] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:46 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:47.112261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f84f97f3-6d52-494a-a742-48eec20c2896 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:47.114098 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f84f97f3-6d52-494a-a742-48eec20c2896 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:47.123924 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f84f97f3-6d52-494a-a742-48eec20c2896 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:47.124586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f84f97f3-6d52-494a-a742-48eec20c2896 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:47.125815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f84f97f3-6d52-494a-a742-48eec20c2896 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:47.126443 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f84f97f3-6d52-494a-a742-48eec20c2896 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:47.205738 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f84f97f3-6d52-494a-a742-48eec20c2896 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 33823 microversion: 2.1 time: 0.100658 Nov 25 08:46:47.207135 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 510/1010] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:47 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 33823 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:47.750756 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:47.753134 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:47.766211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:47.767393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:47.770612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:47.774361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:48.109874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-fb6e1204-c783-4d9d-966f-fa5c750e4069 req-4e5c9f50-3800-440b-b68f-033745943e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c60725-c104-415f-b7f9-85c3c12c404e", "name": "network-vif-deleted", "tag": "0ff26fce-660e-4b5e-a93e-5455cb4c9d10"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:48.114118 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:46:48.114118 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:46:48.127421 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-fb6e1204-c783-4d9d-966f-fa5c750e4069 req-4e5c9f50-3800-440b-b68f-033745943e70 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:48.128871 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-fb6e1204-c783-4d9d-966f-fa5c750e4069 req-4e5c9f50-3800-440b-b68f-033745943e70 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:48.150606 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:48.166260 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-fb6e1204-c783-4d9d-966f-fa5c750e4069 req-4e5c9f50-3800-440b-b68f-033745943e70 service nova] Creating event network-vif-deleted:0ff26fce-660e-4b5e-a93e-5455cb4c9d10 for instance 18c60725-c104-415f-b7f9-85c3c12c404e on hv-cinder-77819 Nov 25 08:46:48.166692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c0815504-493b-4735-8248-93e2c3c074ba tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 200 len: 1514 microversion: 2.1 time: 0.424318 Nov 25 08:46:48.185049 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 501/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:47 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:46:48.186855 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-fb6e1204-c783-4d9d-966f-fa5c750e4069 req-4e5c9f50-3800-440b-b68f-033745943e70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082765 Nov 25 08:46:48.194434 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 511/1012] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:46:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:46:48.196939 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:48.197939 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:48.205577 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:48.206323 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:48.208736 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:48.209190 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:48.223461 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d2bbe050-dfa2-4688-8778-9d25397ecaac tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:48.225270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d2bbe050-dfa2-4688-8778-9d25397ecaac tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:48.239442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d2bbe050-dfa2-4688-8778-9d25397ecaac tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:48.241073 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d2bbe050-dfa2-4688-8778-9d25397ecaac tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:48.242440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d2bbe050-dfa2-4688-8778-9d25397ecaac tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:48.243232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d2bbe050-dfa2-4688-8778-9d25397ecaac tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:48.368545 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d2bbe050-dfa2-4688-8778-9d25397ecaac tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 34874 microversion: 2.1 time: 0.152244 Nov 25 08:46:48.369463 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 512/1013] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:48 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 34874 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:48.438202 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:48.453689 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:48.455269 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:48.456697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-616a72cb-7698-4fdb-9513-20aa34cdce73 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.270180 Nov 25 08:46:48.457575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 502/1014] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:48 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:49.189103 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:49.190866 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 18c60725-c104-415f-b7f9-85c3c12c404e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:49.199180 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:49.200691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:49.201880 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:49.202586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:49.219476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] HTTP exception thrown: Instance 18c60725-c104-415f-b7f9-85c3c12c404e could not be found. Nov 25 08:46:49.220503 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Returning 404 to user: Instance 18c60725-c104-415f-b7f9-85c3c12c404e could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:46:49.221628 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a33a8e55-261a-4f88-9aa5-e48f9160bb40 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e" status: 404 len: 111 microversion: 2.1 time: 0.038688 Nov 25 08:46:49.225970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 513/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:49 2021] GET /compute/v2.1/servers/18c60725-c104-415f-b7f9-85c3c12c404e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:46:49.383140 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0cfefa03-3b85-4aae-b419-f9682a9e210a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:49.384974 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0cfefa03-3b85-4aae-b419-f9682a9e210a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:49.394544 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cfefa03-3b85-4aae-b419-f9682a9e210a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:49.395674 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cfefa03-3b85-4aae-b419-f9682a9e210a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:49.397127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cfefa03-3b85-4aae-b419-f9682a9e210a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:49.398147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0cfefa03-3b85-4aae-b419-f9682a9e210a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:49.477445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:49.478428 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:49.489786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0cfefa03-3b85-4aae-b419-f9682a9e210a tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 35539 microversion: 2.1 time: 0.110594 Nov 25 08:46:49.490603 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 503/1016] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:49 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 35539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:49.491396 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:49.492139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:49.493146 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:49.493729 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:49.667536 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:49.681150 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:49.682841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:49.684487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4ad9b9b0-f510-41f3-9350-80ab9c6efe56 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.211173 Nov 25 08:46:49.685189 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 514/1017] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:49 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:50.503266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c1859794-f8a6-4331-831d-81f294586f12 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:50.504407 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c1859794-f8a6-4331-831d-81f294586f12 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:50.511424 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1859794-f8a6-4331-831d-81f294586f12 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:50.511895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1859794-f8a6-4331-831d-81f294586f12 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:50.513243 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1859794-f8a6-4331-831d-81f294586f12 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:50.513672 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c1859794-f8a6-4331-831d-81f294586f12 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:50.708194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:50.710442 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:50.722737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:50.723853 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:50.725425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:50.726477 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:50.923045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:50.933363 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:50.936231 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:50.939269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3560e8ff-604c-4169-bdf1-c7d572308c43 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.238717 Nov 25 08:46:50.940404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 515/1018] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:50 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:51.964752 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:51.967147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:51.978176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:51.979821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:51.983918 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:51.984424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:52.211232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:52.222371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:52.224421 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:52.226421 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-dec84d6d-4189-4dda-a0f8-e0a54b0bd4bc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.271266 Nov 25 08:46:52.235697 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 516/1019] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:51 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:52.550429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c1859794-f8a6-4331-831d-81f294586f12 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 37714 microversion: 2.1 time: 2.051093 Nov 25 08:46:52.551329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 504/1020] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:50 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 37714 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:53.246831 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:53.247613 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:53.254022 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:53.254462 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:53.255239 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:53.255702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:53.406174 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:53.414402 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:53.420167 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:53.422237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6b801eee-8f10-4fbc-b3f7-5b49b48c17e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.179147 Nov 25 08:46:53.423278 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 517/1021] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:53 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:53.568471 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a22f1d65-93d7-4931-be6d-613dfb00bb33 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:53.571271 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a22f1d65-93d7-4931-be6d-613dfb00bb33 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:53.586209 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a22f1d65-93d7-4931-be6d-613dfb00bb33 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:53.588062 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a22f1d65-93d7-4931-be6d-613dfb00bb33 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:53.589905 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a22f1d65-93d7-4931-be6d-613dfb00bb33 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:53.591724 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a22f1d65-93d7-4931-be6d-613dfb00bb33 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:53.703046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a22f1d65-93d7-4931-be6d-613dfb00bb33 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 38210 microversion: 2.1 time: 0.141627 Nov 25 08:46:53.704788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 505/1022] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:53 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 38210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:54.440612 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:54.441207 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:54.447336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:54.447804 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:54.448827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:54.449260 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:54.592141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:54.599941 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:54.601415 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:54.602563 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-1e33dbf0-4059-4671-b4e0-967960f74858 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1738 microversion: 2.20 time: 0.165659 Nov 25 08:46:54.603113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 518/1023] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:54 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:54.716403 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e47bc49d-271b-49d3-a83e-096af9ef4a74 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:54.717640 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e47bc49d-271b-49d3-a83e-096af9ef4a74 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:54.725505 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e47bc49d-271b-49d3-a83e-096af9ef4a74 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:54.725977 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e47bc49d-271b-49d3-a83e-096af9ef4a74 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:54.726781 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e47bc49d-271b-49d3-a83e-096af9ef4a74 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:54.727213 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e47bc49d-271b-49d3-a83e-096af9ef4a74 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:54.801956 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e47bc49d-271b-49d3-a83e-096af9ef4a74 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 38213 microversion: 2.1 time: 0.089903 Nov 25 08:46:54.802642 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 506/1024] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:54 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 38213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:55.620546 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:55.621141 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:55.627514 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:55.627988 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:55.628754 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:55.629182 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:55.766679 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:55.774486 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:55.776023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:55.777196 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-84d8db49-0b27-447e-a1d6-0d0576496062 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1720 microversion: 2.20 time: 0.160329 Nov 25 08:46:55.778264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 519/1025] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:55 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:55.814578 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ff18f566-c4b9-4d6d-8970-9105e2ac7406 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:55.815616 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ff18f566-c4b9-4d6d-8970-9105e2ac7406 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:55.822432 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ff18f566-c4b9-4d6d-8970-9105e2ac7406 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:55.822879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ff18f566-c4b9-4d6d-8970-9105e2ac7406 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:55.823966 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ff18f566-c4b9-4d6d-8970-9105e2ac7406 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:55.824404 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ff18f566-c4b9-4d6d-8970-9105e2ac7406 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:56.796525 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:56.797247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:56.803594 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:56.804048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:56.804822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:56.805258 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:56.943209 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:56.952719 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:56.954211 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:56.955361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5195d277-e357-4145-ab67-b523069bb29f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1720 microversion: 2.20 time: 0.162564 Nov 25 08:46:56.955936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 520/1026] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:56 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:57.974084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:57.974764 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:57.981007 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:57.981460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:57.982748 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:57.983266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:58.089268 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ff18f566-c4b9-4d6d-8970-9105e2ac7406 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action" status: 200 len: 38341 microversion: 2.1 time: 2.278493 Nov 25 08:46:58.096466 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 507/1027] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:46:55 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/action => generated 38341 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:46:58.101486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-97462671-5ee7-47db-b316-109ab3757ab2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:58.102203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-97462671-5ee7-47db-b316-109ab3757ab2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:58.111383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-97462671-5ee7-47db-b316-109ab3757ab2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:58.111959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-97462671-5ee7-47db-b316-109ab3757ab2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:58.112951 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-97462671-5ee7-47db-b316-109ab3757ab2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:58.113448 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-97462671-5ee7-47db-b316-109ab3757ab2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:58.121148 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:58.130450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:58.131982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:58.133183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-16bd8539-2bd9-4590-9992-964937c3138f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1720 microversion: 2.20 time: 0.162781 Nov 25 08:46:58.133728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 521/1028] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:57 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:46:58.140244 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-97462671-5ee7-47db-b316-109ab3757ab2 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/ips" status: 200 len: 146 microversion: 2.1 time: 0.042921 Nov 25 08:46:58.140844 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 508/1029] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Nov 25 08:46:58 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:46:58.671983 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-a6d62af1-62de-43f1-bd04-5f7cc4800724 req-df5b9d65-ba94-4540-b624-916af49f208b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf899124-0fb5-489e-a87e-f94a838091d7", "name": "network-vif-unplugged", "status": "completed", "tag": "358bd9c3-fe7c-46ac-9c3c-82e4369e8f66"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:58.674018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:46:58.674018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:46:58.681577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-a6d62af1-62de-43f1-bd04-5f7cc4800724 req-df5b9d65-ba94-4540-b624-916af49f208b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:58.682023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-a6d62af1-62de-43f1-bd04-5f7cc4800724 req-df5b9d65-ba94-4540-b624-916af49f208b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:58.696344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-a6d62af1-62de-43f1-bd04-5f7cc4800724 req-df5b9d65-ba94-4540-b624-916af49f208b service nova] Creating event network-vif-unplugged:358bd9c3-fe7c-46ac-9c3c-82e4369e8f66 for instance bf899124-0fb5-489e-a87e-f94a838091d7 on hv-cinder-77819 Nov 25 08:46:58.701535 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-a6d62af1-62de-43f1-bd04-5f7cc4800724 req-df5b9d65-ba94-4540-b624-916af49f208b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033643 Nov 25 08:46:58.703079 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 522/1030] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:46:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:46:59.153308 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:59.153909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:59.160530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:59.160991 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:59.161758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:59.162184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:59.247327 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-323851751", "imageRef": "45039671-a61c-4812-a4ff-f5e108632584", "flavorRef": "452", "networks": [{"uuid": "174db974-9d6e-4aca-b06c-4c66d94ce421"}]}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:59.307864 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] validate_networks() for [('174db974-9d6e-4aca-b06c-4c66d94ce421', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:46:59.343551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:59.352820 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:59.354498 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:46:59.356796 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-78fcf157-6f3c-4438-b26e-7fc0906c1262 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1720 microversion: 2.20 time: 0.207152 Nov 25 08:46:59.357590 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 509/1031] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:46:59 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:46:59.463199 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a09aff9f-3f47-4b19-b94d-0c589a0a3b7f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd3095a-678b-452a-af5e-9aa976714c9a"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:46:59.464414 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a09aff9f-3f47-4b19-b94d-0c589a0a3b7f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:46:59.471420 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a09aff9f-3f47-4b19-b94d-0c589a0a3b7f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:59.471936 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a09aff9f-3f47-4b19-b94d-0c589a0a3b7f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:59.472740 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a09aff9f-3f47-4b19-b94d-0c589a0a3b7f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:59.473172 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a09aff9f-3f47-4b19-b94d-0c589a0a3b7f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:59.758581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a09aff9f-3f47-4b19-b94d-0c589a0a3b7f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299102 Nov 25 08:46:59.759879 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 510/1032] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:46:59 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:46:59.856988 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:46:59.857405 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:46:59.858034 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:46:59.859031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:46:59.859438 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:46:59.872621 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:59.873063 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:59.874077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:46:59.874574 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:46:59.891785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Getting quotas for project 3500139a1c5d49a1ae51cf5064532856. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:46:59.895771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Getting quotas for user d648a8a7abcd43b2a2f32cdbbf296597 and project 3500139a1c5d49a1ae51cf5064532856. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:46:59.906987 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:46:59.909424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='45039671-a61c-4812-a4ff-f5e108632584',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:46:59.960404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8cd64f1e-746e-4d30-848f-75f7c958858b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717790 Nov 25 08:46:59.961176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 523/1033] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:46:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:46:59.972580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d0621109-df63-42a6-8547-9ce92f4ab6f4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:46:59.973265 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d0621109-df63-42a6-8547-9ce92f4ab6f4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:00.027856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d0621109-df63-42a6-8547-9ce92f4ab6f4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:00.035230 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d0621109-df63-42a6-8547-9ce92f4ab6f4 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1218 microversion: 2.1 time: 0.067724 Nov 25 08:47:00.035898 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 511/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:46:59 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:00.387827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:00.388706 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:00.396606 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:00.397045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:00.398016 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:00.398450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:00.537634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:00.546389 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:00.548216 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:00.549385 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c5e44116-2cbf-4d37-bff2-07c324ed7605 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1663 microversion: 2.20 time: 0.165438 Nov 25 08:47:00.549941 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 524/1035] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:00 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:00.568894 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a4e8c566-ffa5-4f51-83d0-acd1ae0a7036 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb503370-1c3f-4bbf-91be-93c442a7c835"}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:00.570162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a4e8c566-ffa5-4f51-83d0-acd1ae0a7036 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:00.578832 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a4e8c566-ffa5-4f51-83d0-acd1ae0a7036 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:00.579665 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a4e8c566-ffa5-4f51-83d0-acd1ae0a7036 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:00.580484 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a4e8c566-ffa5-4f51-83d0-acd1ae0a7036 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:00.580928 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a4e8c566-ffa5-4f51-83d0-acd1ae0a7036 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:00.845524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a4e8c566-ffa5-4f51-83d0-acd1ae0a7036 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281188 Nov 25 08:47:00.846134 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 512/1036] 10.222.0.46 () {62 vars in 1363 bytes} [Thu Nov 25 08:47:00 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 25 08:47:00.968840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-192329df-9124-4dd6-b608-404768088204 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:00.969451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-192329df-9124-4dd6-b608-404768088204 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:00.975464 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-192329df-9124-4dd6-b608-404768088204 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:00.978805 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-192329df-9124-4dd6-b608-404768088204 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:00.978958 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-192329df-9124-4dd6-b608-404768088204 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:00.979481 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-192329df-9124-4dd6-b608-404768088204 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:01.053456 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:01.054502 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:01.064760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:01.065181 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:01.065993 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:01.066428 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:01.174923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:01.183211 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e2168d67-891b-4b17-b9da-f378b72399d5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1288 microversion: 2.1 time: 0.134216 Nov 25 08:47:01.184093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 513/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:01 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1288 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:47:01.240357 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-192329df-9124-4dd6-b608-404768088204 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-volume_attachments/eb503370-1c3f-4bbf-91be-93c442a7c835" status: 202 len: 0 microversion: 2.20 time: 0.276218 Nov 25 08:47:01.241143 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 525/1038] 10.222.0.46 () {60 vars in 1456 bytes} [Thu Nov 25 08:47:00 2021] DELETE /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-volume_attachments/eb503370-1c3f-4bbf-91be-93c442a7c835 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:47:01.299109 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-be6908df-c403-491b-b291-3513663f27db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:01.299711 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-be6908df-c403-491b-b291-3513663f27db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:01.305642 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be6908df-c403-491b-b291-3513663f27db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:01.306097 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be6908df-c403-491b-b291-3513663f27db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:01.306892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be6908df-c403-491b-b291-3513663f27db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:01.307520 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be6908df-c403-491b-b291-3513663f27db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:01.416268 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-be6908df-c403-491b-b291-3513663f27db tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action" status: 202 len: 0 microversion: 2.20 time: 0.120994 Nov 25 08:47:01.417393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 514/1039] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Nov 25 08:47:01 2021] POST /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:47:01.426561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:01.427841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:01.434770 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:01.435520 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:01.439245 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:01.439925 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:01.645837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:01.653839 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:01.655449 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:01.656757 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-46eb6259-7728-41cd-ae46-922ce02efa2e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1671 microversion: 2.20 time: 0.234569 Nov 25 08:47:01.657676 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 526/1040] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:01 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:02.203834 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:02.205078 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:02.212262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:02.212892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:02.213874 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:02.214315 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:02.448185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:02.457212 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b5922ad7-e253-4b39-8fd7-1b3172dcc282 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.258562 Nov 25 08:47:02.457783 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 515/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:02 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:02.528166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-3bb208ae-1eb9-4c58-aabf-b4035b9340a2 req-bcf458d9-9cb7-42a1-875f-9b0e7a92d2c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575780c8-cad0-45d8-91ce-3fd351d9e967", "tag": "7453e83d-6b4c-477d-8c32-cebb3c79ef9a"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:02.531077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:47:02.531077 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:47:02.542037 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-3bb208ae-1eb9-4c58-aabf-b4035b9340a2 req-bcf458d9-9cb7-42a1-875f-9b0e7a92d2c6 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:02.542393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-3bb208ae-1eb9-4c58-aabf-b4035b9340a2 req-bcf458d9-9cb7-42a1-875f-9b0e7a92d2c6 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:02.557202 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-3bb208ae-1eb9-4c58-aabf-b4035b9340a2 req-bcf458d9-9cb7-42a1-875f-9b0e7a92d2c6 service nova] Creating event network-changed:7453e83d-6b4c-477d-8c32-cebb3c79ef9a for instance 575780c8-cad0-45d8-91ce-3fd351d9e967 on hv-cinder-77819 Nov 25 08:47:02.563120 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-3bb208ae-1eb9-4c58-aabf-b4035b9340a2 req-bcf458d9-9cb7-42a1-875f-9b0e7a92d2c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040292 Nov 25 08:47:02.563864 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 527/1042] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:47:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:02.673964 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:02.674564 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:02.680444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:02.680887 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:02.681657 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:02.682086 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:02.958942 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:02.967210 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:02.968771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:02.970057 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-258dc0a2-ad8b-45c4-b274-95a589236b0f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.299813 Nov 25 08:47:02.981083 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 516/1043] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:02 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:03.476702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:03.477308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:03.484371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:03.484938 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:03.485728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:03.486157 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:03.845108 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:03.853065 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b3d24cdd-5d26-4cbe-9feb-0d43630a899d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.380455 Nov 25 08:47:03.863074 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 528/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:03 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:03.988897 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:03.989486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:03.996982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:03.996982 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:03.998355 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:03.999102 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:04.306153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:04.318446 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:04.320006 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:04.321230 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3d67907c-37ee-4c1d-a33e-132dd2cd24d4 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.336052 Nov 25 08:47:04.321792 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 517/1045] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:03 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:04.871467 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:04.873249 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:04.881471 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:04.882308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:04.883013 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:04.883368 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:05.039314 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:05.047445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cb61420f-d69f-4c4c-9c61-d0fb3f518e34 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.180693 Nov 25 08:47:05.048623 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 529/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:04 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:05.341720 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:05.342406 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:05.350009 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:05.350456 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:05.351331 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:05.351817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:05.543632 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:05.558605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:05.562321 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:05.564592 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ecf61a66-e688-40f1-bd48-c7fe70e5c2c1 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.226303 Nov 25 08:47:05.565927 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 518/1047] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:05 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:06.065254 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:06.065914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:06.073236 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:06.073785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:06.074691 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:06.075197 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:06.233709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:06.241346 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-c8fcfb10-fd17-4bc2-a079-724f81fc1f7b tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.180267 Nov 25 08:47:06.242236 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 530/1048] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:06 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:06.587809 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:06.591425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:06.598861 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:06.599289 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:06.600131 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:06.600563 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:06.786626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:06.796250 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:06.797827 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:06.799554 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-68362c69-b380-4173-acc2-30d634aeab87 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.217769 Nov 25 08:47:06.800158 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 519/1049] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:06 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:07.267169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:07.267897 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:07.274327 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:07.274863 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:07.275791 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:07.276313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:07.498867 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:07.506653 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a98bc9d2-b5f6-44a5-99df-2a5ad4756bd7 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.250504 Nov 25 08:47:07.507234 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 531/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:07 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:07.829292 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:07.831859 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:07.845189 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:07.845737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:07.846623 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:07.847149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:08.019248 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:08.042906 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:08.044542 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:08.045824 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7036a978-5098-418a-8694-17ea3f6273a0 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.226918 Nov 25 08:47:08.046659 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 520/1051] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:07 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:47:08.526203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:08.527043 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:08.535675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:08.536182 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:08.536900 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:08.537328 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:08.716733 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:08.726887 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-03086313-42b7-4f13-b4d4-ce58b0659737 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.205307 Nov 25 08:47:08.727530 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 532/1052] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:08 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:08.847148 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-db76e1cd-fde1-44c3-b1a3-1af0870df9a0 req-219720cb-b6ed-4166-9c35-375c6df8fb69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575780c8-cad0-45d8-91ce-3fd351d9e967", "name": "network-vif-plugged", "status": "completed", "tag": "7453e83d-6b4c-477d-8c32-cebb3c79ef9a"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:08.848938 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:47:08.848938 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:47:08.856454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-db76e1cd-fde1-44c3-b1a3-1af0870df9a0 req-219720cb-b6ed-4166-9c35-375c6df8fb69 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:08.856895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-db76e1cd-fde1-44c3-b1a3-1af0870df9a0 req-219720cb-b6ed-4166-9c35-375c6df8fb69 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:08.872130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-db76e1cd-fde1-44c3-b1a3-1af0870df9a0 req-219720cb-b6ed-4166-9c35-375c6df8fb69 service nova] Creating event network-vif-plugged:7453e83d-6b4c-477d-8c32-cebb3c79ef9a for instance 575780c8-cad0-45d8-91ce-3fd351d9e967 on hv-cinder-77819 Nov 25 08:47:08.877570 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-db76e1cd-fde1-44c3-b1a3-1af0870df9a0 req-219720cb-b6ed-4166-9c35-375c6df8fb69 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034156 Nov 25 08:47:08.878182 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 521/1053] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:47:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:09.065934 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:09.066451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:09.073526 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:09.073995 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:09.074782 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:09.075217 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:09.212527 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:09.223290 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:09.224951 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:09.226378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-33290496-36a3-4b02-bb40-79937f72c348 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.164002 Nov 25 08:47:09.237177 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 533/1054] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:09 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:09.745083 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:09.745781 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:09.752549 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:09.752995 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:09.753768 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:09.754197 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:09.930352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:09.938383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fdfcc587-1d5d-4bef-83c0-2e8c4d7b31f0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.197235 Nov 25 08:47:09.939145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 522/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:09 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:10.244794 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:10.245748 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:10.253836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:10.254287 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:10.255080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:10.255516 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:10.405025 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:10.417031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:10.418662 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:10.420626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5fd9a8a4-5075-4ffa-91bd-4ea87d1730cc tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.178855 Nov 25 08:47:10.421426 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 534/1056] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:10 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:10.958012 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:10.958631 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:10.965326 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:10.965780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:10.966605 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:10.967193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:11.139647 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:11.152585 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ae35bbc5-5c24-4240-a53d-07f67cdd8cb0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.197873 Nov 25 08:47:11.153643 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 523/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:10 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:11.438599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:11.439217 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:11.446545 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:11.447005 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:11.448120 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:11.448565 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:11.624640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:11.634372 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:11.635849 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:11.636927 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-f9b7501d-b04a-4470-9916-132c8f5517b9 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.202476 Nov 25 08:47:11.637501 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 535/1058] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:11 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:12.179797 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:12.181514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:12.189915 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:12.190780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:12.192408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:12.193295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:12.376187 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:12.395895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2a1031ac-57fd-4057-8ac9-824fe3121fab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.219876 Nov 25 08:47:12.406841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 524/1059] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:12 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:12.660080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:12.660841 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:12.671846 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:12.672653 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:12.674090 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:12.674910 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:12.840434 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:12.850541 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:12.852318 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:12.853734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-86757a30-eec6-48db-9597-983a0c8d5a0e tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.201024 Nov 25 08:47:12.865694 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 536/1060] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:12 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:13.415176 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:13.416757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:13.424101 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:13.424651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:13.425510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:13.426017 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:13.577193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:13.584984 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-927489cc-a1a4-443b-88ed-1f37cf677797 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.174277 Nov 25 08:47:13.585566 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 525/1061] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:13 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:13.873418 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:13.874355 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:13.880668 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:13.881114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:13.881893 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:13.882328 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:14.039343 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:14.048686 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:14.050184 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:14.051357 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-912ea4f6-5c22-47e8-8f29-17d29c4e774f tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.182335 Nov 25 08:47:14.051952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 537/1062] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:13 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:14.602824 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:14.605188 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:14.619530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:14.624875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:14.627004 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:14.627458 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:14.781368 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:14.788732 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9499a9d1-b1d2-4a0d-b9a3-52460235749e tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.190229 Nov 25 08:47:14.789299 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 526/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:14 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:15.070233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:15.070906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:15.079017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:15.079468 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:15.080306 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:15.080742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:15.220149 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:15.228258 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:15.229737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:15.230894 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-56d489ac-1173-4dcf-b17c-726d6ee70091 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.164739 Nov 25 08:47:15.231448 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 538/1064] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:15 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:47:15.805965 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:15.806555 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:15.813432 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:15.813872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:15.814648 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:15.815076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:15.961740 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:15.969454 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-a9879860-3318-4452-ace6-0e109cf17498 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.167051 Nov 25 08:47:15.970042 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 527/1065] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:15 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:16.249015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:16.249573 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:16.256101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:16.256821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:16.257616 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:16.258050 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:16.435837 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:16.445393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:16.446881 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:16.448347 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ee41c73b-835c-40ee-bbe5-603f975197d6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.203234 Nov 25 08:47:16.448909 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 539/1066] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:16 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:47:16.987370 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:16.988014 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:16.994386 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:16.994833 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:16.995630 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:16.996062 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:17.147399 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:17.156635 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-738bb04e-b171-4909-86db-9c780aa5b6cf tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1318 microversion: 2.1 time: 0.172802 Nov 25 08:47:17.157468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 528/1067] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:16 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:17.467656 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:17.468278 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:17.474779 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:17.475233 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:17.476063 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:17.476504 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:17.645262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:17.657042 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:17.658743 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:17.660561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e76edebe-d388-4cd2-9f81-10af68dbeafb tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.196536 Nov 25 08:47:17.661143 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 540/1068] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:17 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:17.971657 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-20a074c7-ede6-4e7f-ac2d-163e7a3c75bd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:17.972750 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-20a074c7-ede6-4e7f-ac2d-163e7a3c75bd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:17.979046 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-20a074c7-ede6-4e7f-ac2d-163e7a3c75bd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:17.979501 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-20a074c7-ede6-4e7f-ac2d-163e7a3c75bd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:17.980341 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-20a074c7-ede6-4e7f-ac2d-163e7a3c75bd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:17.980787 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-20a074c7-ede6-4e7f-ac2d-163e7a3c75bd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.014431 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-20a074c7-ede6-4e7f-ac2d-163e7a3c75bd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Nov 25 08:47:18.015138 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 529/1069] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:47:17 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:18.026351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6e2722b4-986d-4729-a08e-7ecadf69e106 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:18.026851 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6e2722b4-986d-4729-a08e-7ecadf69e106 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:18.034338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e2722b4-986d-4729-a08e-7ecadf69e106 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.034786 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e2722b4-986d-4729-a08e-7ecadf69e106 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.035636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e2722b4-986d-4729-a08e-7ecadf69e106 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.036071 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6e2722b4-986d-4729-a08e-7ecadf69e106 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.072097 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6e2722b4-986d-4729-a08e-7ecadf69e106 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/5fd3095a-678b-452a-af5e-9aa976714c9a" status: 200 len: 194 microversion: 2.1 time: 0.049622 Nov 25 08:47:18.072986 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 541/1070] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Nov 25 08:47:18 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/5fd3095a-678b-452a-af5e-9aa976714c9a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:18.178552 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:18.179300 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:18.186191 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.186625 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.187415 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.187871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.400241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:18.409225 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-665d1b08-6c17-42e2-8b3e-9a24107327b0 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1507 microversion: 2.1 time: 0.234274 Nov 25 08:47:18.409807 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 530/1071] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:18 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:18.427057 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7aee0ab7-e022-43b3-860b-230095b5229d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8f94ca9-0e4d-4d99-a8d3-b8542c36d530", "device": "/dev/sdb"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:18.428296 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7aee0ab7-e022-43b3-860b-230095b5229d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:18.434977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7aee0ab7-e022-43b3-860b-230095b5229d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.436933 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7aee0ab7-e022-43b3-860b-230095b5229d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.437129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7aee0ab7-e022-43b3-860b-230095b5229d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.437461 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7aee0ab7-e022-43b3-860b-230095b5229d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.684232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:18.684940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:18.691018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.691960 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.693325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:18.694025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:18.700284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7aee0ab7-e022-43b3-860b-230095b5229d tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "POST /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275668 Nov 25 08:47:18.700284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 542/1072] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:47:18 2021] POST /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:18.847108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:18.855986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:18.857581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:18.859056 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0b829e5e-dbc5-47ac-8c04-1581bf4bf504 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.179317 Nov 25 08:47:18.860157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 531/1073] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:18 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:19.426166 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-599e56f9-18ac-46dc-9395-345ba730de32 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07638459-fec8-414d-b650-d2eeb28c6f13"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:19.427227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-599e56f9-18ac-46dc-9395-345ba730de32 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:19.433452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-599e56f9-18ac-46dc-9395-345ba730de32 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:19.433939 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-599e56f9-18ac-46dc-9395-345ba730de32 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:19.434771 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-599e56f9-18ac-46dc-9395-345ba730de32 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:19.435256 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-599e56f9-18ac-46dc-9395-345ba730de32 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:19.672881 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-599e56f9-18ac-46dc-9395-345ba730de32 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251277 Nov 25 08:47:19.673629 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 543/1074] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Nov 25 08:47:19 2021] POST /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:47:19.878592 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:19.879364 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:19.886137 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:19.886585 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:19.887431 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:19.888143 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:20.032621 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:20.040606 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:20.042145 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:20.043354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7ccdedcd-07c4-4d9a-b477-f4e0019e5db7 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.168550 Nov 25 08:47:20.043965 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 532/1075] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:19 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:20.868572 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-6d17d968-a633-42fd-b1d7-73c9ec6a289c req-8e321937-c7b7-4c21-83cb-cc8ecf2f2d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf899124-0fb5-489e-a87e-f94a838091d7", "name": "network-vif-plugged", "status": "completed", "tag": "358bd9c3-fe7c-46ac-9c3c-82e4369e8f66"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:20.871399 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:47:20.871399 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:47:20.882574 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-6d17d968-a633-42fd-b1d7-73c9ec6a289c req-8e321937-c7b7-4c21-83cb-cc8ecf2f2d92 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:20.883025 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-6d17d968-a633-42fd-b1d7-73c9ec6a289c req-8e321937-c7b7-4c21-83cb-cc8ecf2f2d92 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:20.899686 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-6d17d968-a633-42fd-b1d7-73c9ec6a289c req-8e321937-c7b7-4c21-83cb-cc8ecf2f2d92 service nova] Creating event network-vif-plugged:358bd9c3-fe7c-46ac-9c3c-82e4369e8f66 for instance bf899124-0fb5-489e-a87e-f94a838091d7 on hv-cinder-77819 Nov 25 08:47:20.906161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-6d17d968-a633-42fd-b1d7-73c9ec6a289c req-8e321937-c7b7-4c21-83cb-cc8ecf2f2d92 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042027 Nov 25 08:47:20.906962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 544/1076] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:47:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:21.063068 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:21.063913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:21.070435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:21.071027 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:21.071895 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:21.072776 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:21.257076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:21.265860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:21.267400 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:21.268612 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-ecc7ec38-d312-4bbe-ae08-f0ee2b3fd722 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.210016 Nov 25 08:47:21.269213 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 533/1077] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:21 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:22.287786 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:22.288360 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:22.294888 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:22.295524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:22.296422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:22.296853 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:22.459730 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:22.468605 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:22.470097 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:22.471413 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7851ddaa-67f1-4571-bb1e-898e93e6974a tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1729 microversion: 2.20 time: 0.188471 Nov 25 08:47:22.472377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 545/1078] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:22 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:23.489683 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:23.490287 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:23.496716 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:23.497169 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:23.499175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:23.499742 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:23.645205 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:23.653391 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:23.655005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:23.656214 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f5972583-faeb-4ebd-a05c-bd54c5900579 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1716 microversion: 2.20 time: 0.170351 Nov 25 08:47:23.656782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 534/1079] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:47:23 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:47:35.585586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ac32437f-b619-41b0-b73e-d31e3632a0f7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:35.586523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ac32437f-b619-41b0-b73e-d31e3632a0f7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:35.593284 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac32437f-b619-41b0-b73e-d31e3632a0f7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:35.593732 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac32437f-b619-41b0-b73e-d31e3632a0f7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:35.594524 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac32437f-b619-41b0-b73e-d31e3632a0f7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:35.594968 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ac32437f-b619-41b0-b73e-d31e3632a0f7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:35.625403 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ac32437f-b619-41b0-b73e-d31e3632a0f7 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043491 Nov 25 08:47:35.625961 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 546/1080] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:47:35 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:35.886479 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-438b926e-4e8d-4a73-8f41-eca6b7e12d2b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:35.887040 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-438b926e-4e8d-4a73-8f41-eca6b7e12d2b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:35.894551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-438b926e-4e8d-4a73-8f41-eca6b7e12d2b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:35.895008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-438b926e-4e8d-4a73-8f41-eca6b7e12d2b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:35.895841 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-438b926e-4e8d-4a73-8f41-eca6b7e12d2b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:35.896293 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-438b926e-4e8d-4a73-8f41-eca6b7e12d2b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:35.926584 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-438b926e-4e8d-4a73-8f41-eca6b7e12d2b tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/5fd3095a-678b-452a-af5e-9aa976714c9a" status: 200 len: 194 microversion: 2.1 time: 0.043818 Nov 25 08:47:35.927198 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 535/1081] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Nov 25 08:47:35 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/5fd3095a-678b-452a-af5e-9aa976714c9a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:35.936913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:35.937436 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:35.943404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:35.943891 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:35.944673 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:35.945113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:36.021663 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lazy-loading 'services' on Instance uuid dcf3f071-40f2-4ec3-a1df-0e78f884f182 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:47:36.091227 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-aec9645b-ddba-4927-be41-5d2803a7e0c0 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/5fd3095a-678b-452a-af5e-9aa976714c9a" status: 202 len: 0 microversion: 2.1 time: 0.158165 Nov 25 08:47:36.091880 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 547/1082] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:47:35 2021] DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/5fd3095a-678b-452a-af5e-9aa976714c9a => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:47:40.071475 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:40.072352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:40.079514 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:40.079986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:40.080780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:40.081213 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:40.162143 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lazy-loading 'services' on Instance uuid 575780c8-cad0-45d8-91ce-3fd351d9e967 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:47:40.237249 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b15f4ebf-5156-4c46-8e5f-82b4f059a1df tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "DELETE /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967/os-volume_attachments/f8f94ca9-0e4d-4d99-a8d3-b8542c36d530" status: 202 len: 0 microversion: 2.1 time: 0.169241 Nov 25 08:47:40.237853 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 536/1083] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:47:40 2021] DELETE /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967/os-volume_attachments/f8f94ca9-0e4d-4d99-a8d3-b8542c36d530 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 25 08:47:40.358470 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-ea98e86e-77c7-4c2c-b35e-abff78aedc0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:40.359131 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-ea98e86e-77c7-4c2c-b35e-abff78aedc0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:40.366180 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ea98e86e-77c7-4c2c-b35e-abff78aedc0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:40.366639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ea98e86e-77c7-4c2c-b35e-abff78aedc0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:40.367429 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ea98e86e-77c7-4c2c-b35e-abff78aedc0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:40.367962 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-ea98e86e-77c7-4c2c-b35e-abff78aedc0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:40.398498 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-ea98e86e-77c7-4c2c-b35e-abff78aedc0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/07638459-fec8-414d-b650-d2eeb28c6f13" status: 200 len: 194 microversion: 2.1 time: 0.045073 Nov 25 08:47:40.399092 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 548/1084] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Nov 25 08:47:40 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/07638459-fec8-414d-b650-d2eeb28c6f13 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:40.410599 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:40.411169 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:40.417425 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:40.417865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:40.418693 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:40.419117 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:40.507868 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.objects.instance [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lazy-loading 'services' on Instance uuid dcf3f071-40f2-4ec3-a1df-0e78f884f182 {{(pid=122643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:47:40.585025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1719e81e-ca7e-4faf-860d-0c9ab48fc6be tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/07638459-fec8-414d-b650-d2eeb28c6f13" status: 202 len: 0 microversion: 2.1 time: 0.177991 Nov 25 08:47:40.585946 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 537/1085] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Nov 25 08:47:40 2021] DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments/07638459-fec8-414d-b650-d2eeb28c6f13 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:47:42.412400 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:42.413129 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:42.419179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:42.419674 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:42.421117 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:42.421551 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:42.449394 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:47:42.547964 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e1fa58fe-4b62-4909-b5af-e09ae428a6ab tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "DELETE /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 204 len: 0 microversion: 2.1 time: 0.139287 Nov 25 08:47:42.548665 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 549/1086] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:47:42 2021] DELETE /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:47:42.558934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:42.559669 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:42.565833 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:42.566288 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:42.567076 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:42.567517 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:42.722699 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:42.731462 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-749fb9a5-1d2f-41cc-9ccf-9d8efa6622e3 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1513 microversion: 2.1 time: 0.176947 Nov 25 08:47:42.742150 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 538/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:42 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:43.025590 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1762149408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-739661517", "security_groups": [{"name": "tempest-secgroup-smoke-497791862"}], "block_device_mapping_v2": [{"uuid": "d6e8b40c-de58-4484-9ecb-0f63939e4502", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b7242cf-308b-4aee-a391-1d7432608cad"}]}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:43.145607 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.network.neutron [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] validate_networks() for [('0b7242cf-308b-4aee-a391-1d7432608cad', None, None, None, None, None)] {{(pid=122641) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:47:43.537758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Flavor limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:47:43.538424 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Image limits 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:47:43.538634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Flavor pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:47:43.539040 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Image pref 0:0:0 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:47:43.539445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.virt.hardware [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122641) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:47:43.549338 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:43.549782 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:43.550589 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:43.551023 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:43.568047 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:47:43.572455 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Getting quotas for user 16a2f54eb10148c48a3cdd2641da5315 and project ea2e5b2d558c4540ba188353dd3c27e3. Resources: {'instances', 'ram', 'cores'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:47:43.635597 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Going to run 1 instances... {{(pid=122641) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:47:43.637991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6e8b40c-de58-4484-9ecb-0f63939e4502',volume_size=None,volume_type=None)] {{(pid=122641) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:47:43.750515 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:43.751240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:43.757642 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:43.758125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:43.758922 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:43.759356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:43.778416 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-727b6ba5-e153-476a-a426-cc1a567f7119 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756825 Nov 25 08:47:43.779784 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 550/1088] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:47:43 2021] POST /compute/v2.1/servers => generated 405 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:47:43.794354 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-21d91797-6b17-487a-bd96-d09dfba185da tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:43.795440 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-21d91797-6b17-487a-bd96-d09dfba185da tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:43.883241 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-21d91797-6b17-487a-bd96-d09dfba185da tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:43.894756 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-21d91797-6b17-487a-bd96-d09dfba185da tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1094 microversion: 2.1 time: 0.105485 Nov 25 08:47:43.895667 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 551/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:43 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1094 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:43.928797 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2350a41c-d3ce-4d6e-8563-399701ecca0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:43.930378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2350a41c-d3ce-4d6e-8563-399701ecca0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:43.942147 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2350a41c-d3ce-4d6e-8563-399701ecca0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:43.942599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2350a41c-d3ce-4d6e-8563-399701ecca0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:43.943423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2350a41c-d3ce-4d6e-8563-399701ecca0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:43.943903 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2350a41c-d3ce-4d6e-8563-399701ecca0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:43.978483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2350a41c-d3ce-4d6e-8563-399701ecca0e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057905 Nov 25 08:47:43.979113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 552/1090] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:47:43 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:47:43.995241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:44.009241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8e5470ae-4473-48c3-93c2-efcb27b644e5 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1513 microversion: 2.1 time: 0.262738 Nov 25 08:47:44.010537 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 539/1091] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:43 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:47:44.130196 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b155f053-1658-421f-9500-ba40473cfbb8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:44.131573 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b155f053-1658-421f-9500-ba40473cfbb8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:44.138150 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b155f053-1658-421f-9500-ba40473cfbb8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.138984 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b155f053-1658-421f-9500-ba40473cfbb8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:44.139465 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b155f053-1658-421f-9500-ba40473cfbb8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.139939 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b155f053-1658-421f-9500-ba40473cfbb8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:44.172973 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b155f053-1658-421f-9500-ba40473cfbb8 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046187 Nov 25 08:47:44.173538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 553/1092] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Nov 25 08:47:44 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 25 08:47:44.257048 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:44.257656 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:44.269541 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.270350 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:44.272016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.273018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:44.305753 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Going to try to terminate instance {{(pid=122643) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:47:44.390464 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-05052b64-5191-4bb8-b325-7f8fe69abb8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 204 len: 0 microversion: 2.1 time: 0.139391 Nov 25 08:47:44.391533 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 540/1093] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:47:44 2021] DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:47:44.402085 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:44.403228 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:44.415323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.416156 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:44.417390 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.418196 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:44.593925 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:44.607377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d5032e87-67b3-4496-8f4f-4696900e60e6 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1673 microversion: 2.1 time: 0.210583 Nov 25 08:47:44.608261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 554/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:44 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:44.922872 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:44.924245 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:44.930812 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.931265 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:44.932262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:44.932705 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:45.035971 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:45.036836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:45.044217 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:45.044787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:45.045728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:45.047045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:45.292896 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:45.302107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bebd90b1-23a0-4fb7-9e85-cacbdd9a56ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1192 microversion: 2.1 time: 0.384158 Nov 25 08:47:45.302588 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 541/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:44 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1192 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:45.626271 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:45.627036 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:45.629276 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd648a8a7abcd43b2a2f32cdbbf296597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3500139a1c5d49a1ae51cf5064532856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:45.635129 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:45.635756 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:45.636827 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:45.637494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:45.651701 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0f57e7be-f9c8-42f8-a840-2abb731ee14f tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 200 len: 1513 microversion: 2.1 time: 0.620195 Nov 25 08:47:45.653522 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 555/1096] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:45 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 1513 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:45.966199 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-caab3d5a-e23c-4102-9187-149cbeb9ba7c req-11675bec-03ba-486b-a6dc-95904ec0d514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575780c8-cad0-45d8-91ce-3fd351d9e967", "name": "network-vif-deleted", "tag": "7453e83d-6b4c-477d-8c32-cebb3c79ef9a"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:45.968152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:47:45.968152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:47:45.977694 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-caab3d5a-e23c-4102-9187-149cbeb9ba7c req-11675bec-03ba-486b-a6dc-95904ec0d514 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:45.978311 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-caab3d5a-e23c-4102-9187-149cbeb9ba7c req-11675bec-03ba-486b-a6dc-95904ec0d514 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:45.992586 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-caab3d5a-e23c-4102-9187-149cbeb9ba7c req-11675bec-03ba-486b-a6dc-95904ec0d514 service nova] Creating event network-vif-deleted:7453e83d-6b4c-477d-8c32-cebb3c79ef9a for instance 575780c8-cad0-45d8-91ce-3fd351d9e967 on hv-cinder-77819 Nov 25 08:47:45.997590 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-caab3d5a-e23c-4102-9187-149cbeb9ba7c req-11675bec-03ba-486b-a6dc-95904ec0d514 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036621 Nov 25 08:47:46.000702 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 556/1097] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:47:46.033703 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:46.050553 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-8e35995c-3256-4daf-8452-37c760a0b70e tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1673 microversion: 2.1 time: 0.428203 Nov 25 08:47:46.052093 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 542/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:45 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1673 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:46.320728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:46.322025 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:46.329305 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:46.329833 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:46.330647 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:46.331089 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:46.625550 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:46.636432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-83e96e1a-ec73-4af7-abb4-3dc5afea0fca tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.317617 Nov 25 08:47:46.648798 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 557/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:46 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:46.676511 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:46.677572 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] [instance: 575780c8-cad0-45d8-91ce-3fd351d9e967] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:46.687857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:46.688643 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:46.690065 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:46.690810 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:46.719006 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] HTTP exception thrown: Instance 575780c8-cad0-45d8-91ce-3fd351d9e967 could not be found. Nov 25 08:47:46.720049 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] Returning 404 to user: Instance 575780c8-cad0-45d8-91ce-3fd351d9e967 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:47:46.721405 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b9f4b45c-c457-4403-bcfd-fd8508db7236 tempest-VolumesSnapshotTestJSON-299591749 tempest-VolumesSnapshotTestJSON-299591749-project] 10.222.0.46 "GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967" status: 404 len: 111 microversion: 2.1 time: 0.051458 Nov 25 08:47:46.722332 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 543/1100] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:46 2021] GET /compute/v2.1/servers/575780c8-cad0-45d8-91ce-3fd351d9e967 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:47:47.083178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:47.083178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:47.085232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:47.085680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:47.086474 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:47.086906 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:47.442737 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:47.456397 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3fd7ffee-b721-4402-aa6e-d8d605d985cd tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1673 microversion: 2.1 time: 0.382464 Nov 25 08:47:47.457409 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 558/1101] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:47 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1673 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:47.657956 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:47.658560 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:47.665329 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:47.665782 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:47.666871 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:47.667700 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:47.994149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:48.011551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-be02ccbe-325f-4254-a6bb-08644386701f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.358598 Nov 25 08:47:48.020396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 544/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:47 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:48.039471 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-b060ec91-c18e-4e49-808e-1a3664edea15 req-83a5dc2b-8f02-4269-816d-9e9c926bbc30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a29e05-e5eb-42e3-8e3b-a822ab67db2e", "tag": "25b74d77-0925-42e3-828e-9877fbf74b6a"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:48.044161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:47:48.044161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:47:48.062617 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-b060ec91-c18e-4e49-808e-1a3664edea15 req-83a5dc2b-8f02-4269-816d-9e9c926bbc30 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:48.063364 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-b060ec91-c18e-4e49-808e-1a3664edea15 req-83a5dc2b-8f02-4269-816d-9e9c926bbc30 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:48.083704 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-b060ec91-c18e-4e49-808e-1a3664edea15 req-83a5dc2b-8f02-4269-816d-9e9c926bbc30 service nova] Creating event network-changed:25b74d77-0925-42e3-828e-9877fbf74b6a for instance 29a29e05-e5eb-42e3-8e3b-a822ab67db2e on hv-cinder-77819 Nov 25 08:47:48.089821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-b060ec91-c18e-4e49-808e-1a3664edea15 req-83a5dc2b-8f02-4269-816d-9e9c926bbc30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069876 Nov 25 08:47:48.093389 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 559/1103] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:47:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:48.489099 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:48.489935 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:48.503077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:48.503899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:48.504913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:48.505553 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:48.628993 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:48.639252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-258cc15a-f810-4233-b388-a14909d1ae95 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1606 microversion: 2.1 time: 0.160532 Nov 25 08:47:48.640225 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 545/1104] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:48 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1606 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:49.034121 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:49.034815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:49.040998 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:49.041626 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:49.042255 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:49.042692 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:49.447997 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:49.455885 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d4e5b62a-099c-4157-9461-a9f8fb3f4c68 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.427044 Nov 25 08:47:49.456465 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 560/1105] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:49 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:49.659319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:49.659319 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:49.666598 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:49.667095 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:49.667940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:49.668480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:49.739538 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:49.747923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cc0ff6aa-b1b6-44c3-8758-025c36502182 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1606 microversion: 2.1 time: 0.093753 Nov 25 08:47:49.749007 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 546/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:49 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:50.157785 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-698961c6-3818-49b6-bdf6-de9048237a3e req-cc4ab241-665d-4f94-955e-a827f46e23c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf3f071-40f2-4ec3-a1df-0e78f884f182", "name": "network-vif-deleted", "tag": "13716166-79b6-4ab0-86f6-42919899bfee"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:47:50.159247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:47:50.159247 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:47:50.166300 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-698961c6-3818-49b6-bdf6-de9048237a3e req-cc4ab241-665d-4f94-955e-a827f46e23c0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:50.166734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-698961c6-3818-49b6-bdf6-de9048237a3e req-cc4ab241-665d-4f94-955e-a827f46e23c0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:50.177336 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-698961c6-3818-49b6-bdf6-de9048237a3e req-cc4ab241-665d-4f94-955e-a827f46e23c0 service nova] Creating event network-vif-deleted:13716166-79b6-4ab0-86f6-42919899bfee for instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 on hv-cinder-77819 Nov 25 08:47:50.182138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-698961c6-3818-49b6-bdf6-de9048237a3e req-cc4ab241-665d-4f94-955e-a827f46e23c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027956 Nov 25 08:47:50.182892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 561/1107] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:47:50.472461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:50.473075 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:50.479043 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:50.479498 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:50.480768 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:50.481327 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:50.612893 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:50.620127 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-3e7a82e1-3ad2-421e-8b2c-a156421e6152 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.151538 Nov 25 08:47:50.620683 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 547/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:50 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:50.766144 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:50.766853 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:50.773518 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:50.773970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:50.774756 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:50.775194 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:50.837960 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:50.846318 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e387e8b8-71f9-4197-9da3-4208941fc744 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1322 microversion: 2.1 time: 0.084440 Nov 25 08:47:50.846899 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 562/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:50 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1322 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:51.637591 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:51.638234 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:51.645463 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:51.645909 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:51.646687 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:51.647119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:51.784150 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:51.792370 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-cc332aa7-c808-42c0-848c-51f2726defbb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.158454 Nov 25 08:47:51.793108 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 548/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:51 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:51.863959 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:51.864505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:51.871780 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:51.872226 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:51.873009 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:51.873434 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:51.907935 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:51.908378 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:51.908821 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lazy-loading 'fault' on Instance uuid dcf3f071-40f2-4ec3-a1df-0e78f884f182 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:47:51.964501 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a25f49cbab094baabb82829b4b71a5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb52ad5308c241089b4e2e8f09206f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:51.972264 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-89f2fed0-7455-48d2-be82-3b0f5777caed tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 200 len: 1327 microversion: 2.1 time: 0.112185 Nov 25 08:47:51.972865 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 563/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:51 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:47:52.811085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:52.812615 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:52.819335 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:52.820128 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:52.820924 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:52.821521 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:52.980662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:52.989110 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-f1680040-a94a-4330-ad6b-06eb7447848e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.181646 Nov 25 08:47:52.995664 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 549/1112] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:52 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:47:52.995892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:52.995892 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:52.997137 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:52.997585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:52.998374 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:52.999509 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:53.013080 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] HTTP exception thrown: Instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 could not be found. Nov 25 08:47:53.013584 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Returning 404 to user: Instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:47:53.015115 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b5f3688a-31f1-45af-8570-b72cd04a1d8d tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 404 len: 111 microversion: 2.1 time: 0.028427 Nov 25 08:47:53.015635 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 564/1113] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:52 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 25 08:47:53.024144 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c4725d32-8b6f-467b-a30f-e5884a17d879 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '.version_select at 0x7f9708677700>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:53.042215 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c4725d32-8b6f-467b-a30f-e5884a17d879 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867805245" status: 202 len: 0 microversion: 2.1 time: 0.021913 Nov 25 08:47:53.042793 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 550/1114] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Nov 25 08:47:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867805245 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:47:54.012062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:54.012062 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:54.019949 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:54.020689 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:54.021484 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:54.021923 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:54.166288 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:54.174958 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4704fc67-ff63-43e7-8177-631fd9934c6c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.171577 Nov 25 08:47:54.180363 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 565/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:54 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:55.198170 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:55.199476 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:55.208275 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:55.209995 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:55.210845 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:55.211291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:55.385551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:55.391860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-36b10ca3-6d99-4ada-8cb6-b3068178ec84 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.202474 Nov 25 08:47:55.392394 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 551/1116] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:55 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:47:55.994328 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:55.994822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:56.001208 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:56.001650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:56.002439 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:56.002872 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:56.016872 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] HTTP exception thrown: Instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 could not be found. Nov 25 08:47:56.017451 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Returning 404 to user: Instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:47:56.018265 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-33477cd9-ca62-4476-8cc1-1864a179bb90 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 404 len: 111 microversion: 2.1 time: 0.027849 Nov 25 08:47:56.018822 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 566/1117] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:47:55 2021] DELETE /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:47:56.026631 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:56.027244 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: dcf3f071-40f2-4ec3-a1df-0e78f884f182] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:56.034082 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:56.034531 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:56.035328 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:56.035809 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:56.051312 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] HTTP exception thrown: Instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 could not be found. Nov 25 08:47:56.051937 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Returning 404 to user: Instance dcf3f071-40f2-4ec3-a1df-0e78f884f182 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:47:56.052780 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-86a2e2c2-efa2-439d-bfb8-8c373cfc906f tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182" status: 404 len: 111 microversion: 2.1 time: 0.029870 Nov 25 08:47:56.053344 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 552/1118] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:56 2021] GET /compute/v2.1/servers/dcf3f071-40f2-4ec3-a1df-0e78f884f182 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:47:56.408649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:56.409270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:56.415341 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:56.415829 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:56.416617 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:56.417057 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:56.576382 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:56.589415 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-cc30dae1-6834-41ef-b28c-42d1a522a857 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.184806 Nov 25 08:47:56.590370 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 567/1119] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:56 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:57.192651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:57.193162 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:57.199992 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:57.200443 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:57.201230 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:57.202185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:57.216694 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] HTTP exception thrown: Instance d1aedc08-397b-4391-8040-58633cd7f2b0 could not be found. Nov 25 08:47:57.218018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Returning 404 to user: Instance d1aedc08-397b-4391-8040-58633cd7f2b0 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:47:57.218865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d495f35e-364a-472f-b45b-ec3a68091f81 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 404 len: 111 microversion: 2.1 time: 0.029973 Nov 25 08:47:57.219441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 553/1120] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:47:57 2021] DELETE /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:47:57.228508 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:57.229139 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] [instance: d1aedc08-397b-4391-8040-58633cd7f2b0] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:57.236298 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:57.236744 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:57.237538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:57.237969 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:57.252724 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] HTTP exception thrown: Instance d1aedc08-397b-4391-8040-58633cd7f2b0 could not be found. Nov 25 08:47:57.253329 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] Returning 404 to user: Instance d1aedc08-397b-4391-8040-58633cd7f2b0 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:47:57.254207 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5a54eee3-648f-4b4f-aabc-4d87ca1fe423 tempest-AttachVolumeTestJSON-1950078752 tempest-AttachVolumeTestJSON-1950078752-project] 10.222.0.46 "GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0" status: 404 len: 111 microversion: 2.1 time: 0.029362 Nov 25 08:47:57.254770 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 568/1121] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:57 2021] GET /compute/v2.1/servers/d1aedc08-397b-4391-8040-58633cd7f2b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:47:57.606337 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:57.606869 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:57.613520 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:57.613860 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:57.614957 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:57.615388 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:57.801826 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:57.814829 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-eabdeb80-56b9-45af-9be6-e6901cf1ff91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.211864 Nov 25 08:47:57.815792 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 554/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:57 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:47:58.840308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:47:58.840913 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:47:58.847382 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:58.847849 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:58.848634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:47:58.849064 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:47:59.300688 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:47:59.317154 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-030afeca-10b3-4d29-bb3a-47ef4e1457cb tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.480381 Nov 25 08:47:59.317743 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 569/1123] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:47:58 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:00.340697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:00.341421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:00.354580 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:00.355662 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:00.356331 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:00.356904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:00.507469 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:00.515972 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-7b1ed8ff-76da-40ed-af4d-780b73e3dea4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.183919 Nov 25 08:48:00.516559 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 555/1124] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:00 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:01.540432 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:01.541084 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:01.548942 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:01.549388 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:01.550255 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:01.550698 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:01.723176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:01.731982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5002081f-e6eb-4e8d-bcae-9c6735e4799f tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.195167 Nov 25 08:48:01.733116 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 570/1125] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:01 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:02.750762 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:02.751716 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:02.762892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:02.763450 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:02.764441 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:02.764883 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:02.945065 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:02.952913 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5d21b091-6164-48f9-90d0-59a01829b0c1 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.206466 Nov 25 08:48:02.953491 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 556/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:02 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:03.969830 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:03.970472 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:03.978182 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:03.978851 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:03.979929 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:03.980570 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:04.140383 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:04.148921 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-97669be0-8b55-41be-a6a5-31207d22b350 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.182801 Nov 25 08:48:04.149643 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 571/1127] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:03 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:05.166466 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:05.167090 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:05.176021 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:05.176543 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:05.177455 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:05.177934 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:05.313831 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:05.321510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e514d89a-8ecd-4fa7-bc90-2b08082131e4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.158525 Nov 25 08:48:05.322091 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 557/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:05 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:48:06.095936 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-c35add82-51bb-4f5c-9edf-0722dceaaa60 req-a1411045-3f6d-462a-8118-3b95640cce2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a29e05-e5eb-42e3-8e3b-a822ab67db2e", "name": "network-vif-plugged", "status": "completed", "tag": "25b74d77-0925-42e3-828e-9877fbf74b6a"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:48:06.097460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:48:06.097460 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:48:06.105122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-c35add82-51bb-4f5c-9edf-0722dceaaa60 req-a1411045-3f6d-462a-8118-3b95640cce2b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:06.105600 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-c35add82-51bb-4f5c-9edf-0722dceaaa60 req-a1411045-3f6d-462a-8118-3b95640cce2b service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:06.118635 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-c35add82-51bb-4f5c-9edf-0722dceaaa60 req-a1411045-3f6d-462a-8118-3b95640cce2b service nova] Creating event network-vif-plugged:25b74d77-0925-42e3-828e-9877fbf74b6a for instance 29a29e05-e5eb-42e3-8e3b-a822ab67db2e on hv-cinder-77819 Nov 25 08:48:06.124779 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-c35add82-51bb-4f5c-9edf-0722dceaaa60 req-a1411045-3f6d-462a-8118-3b95640cce2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Nov 25 08:48:06.125386 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 572/1129] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:48:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:06.341384 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:06.343380 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:06.350285 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:06.350726 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:06.351755 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:06.352355 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:06.526307 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:06.533632 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-035ebefc-2f22-444d-94e2-1af0a41f1302 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.196453 Nov 25 08:48:06.534197 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 558/1130] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:06 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:07.551436 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:07.552266 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:07.559257 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:07.559736 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:07.561203 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:07.561645 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:07.700649 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:07.707953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-02d9db88-8357-4db1-84ed-1610b541208a tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.160460 Nov 25 08:48:07.708448 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 573/1131] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:07 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:08.724623 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:08.725231 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:08.731847 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:08.732725 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:08.733593 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:08.734027 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:08.885943 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:08.900179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-93c75fb0-0b39-4361-b98a-a7f7ddfe426c tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.178732 Nov 25 08:48:08.901125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 559/1132] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:08 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:09.929128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:09.929817 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:09.937527 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:09.938008 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:09.938825 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:09.939262 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:10.080573 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:10.087796 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-10c2ec20-34b0-4fb4-af77-940dbd860343 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1265 microversion: 2.1 time: 0.162568 Nov 25 08:48:10.088362 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 574/1133] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:09 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:11.105020 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:11.105554 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:11.112325 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:11.112772 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:11.113578 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:11.114007 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:11.255385 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:11.264508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-e52292e7-9252-4fd0-bb4a-4638c70dc3ee tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1452 microversion: 2.1 time: 0.163118 Nov 25 08:48:11.265274 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 560/1134] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:11 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:11.281122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:11.281751 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:11.288512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:11.288641 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:11.289369 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:11.289806 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:11.428530 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:11.437255 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0b5cf0fc-416e-4925-9913-96e22c427637 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1452 microversion: 2.1 time: 0.159915 Nov 25 08:48:11.437938 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 575/1135] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:11 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:11.899601 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c45459f7-cdae-4602-994c-18e4572e8cfe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:11.900508 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-c45459f7-cdae-4602-994c-18e4572e8cfe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:11.912562 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c45459f7-cdae-4602-994c-18e4572e8cfe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:11.912929 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c45459f7-cdae-4602-994c-18e4572e8cfe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:11.913722 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c45459f7-cdae-4602-994c-18e4572e8cfe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:11.914151 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-c45459f7-cdae-4602-994c-18e4572e8cfe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:11.948639 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c45459f7-cdae-4602-994c-18e4572e8cfe tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053031 Nov 25 08:48:11.949206 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 561/1136] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Nov 25 08:48:11 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:12.006014 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:12.006496 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:12.012371 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:12.012811 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:12.014145 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:12.014577 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:12.040745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:48:12.157414 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e3879985-5621-40ae-b3af-9e5de1d6f7e6 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 204 len: 0 microversion: 2.20 time: 0.154835 Nov 25 08:48:12.158089 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 576/1137] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Nov 25 08:48:12 2021] DELETE /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 25 08:48:12.167136 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:12.167666 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:12.174378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:12.175077 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:12.177008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:12.177008 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:12.327383 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:12.335220 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:12.336789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:12.338473 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-60673ff9-0750-46f6-ab78-290301f77525 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.175960 Nov 25 08:48:12.338993 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 562/1138] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:48:12 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 25 08:48:13.360143 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:13.361610 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:13.370623 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:13.374106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:13.375190 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:13.375661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:13.636568 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-442eec0c-f2be-4914-b291-96667e439dab req-4866d267-1d9f-4233-9ddc-92cc82ad9cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a29e05-e5eb-42e3-8e3b-a822ab67db2e", "tag": "25b74d77-0925-42e3-828e-9877fbf74b6a"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:48:13.638758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:48:13.638758 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:48:13.654692 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-442eec0c-f2be-4914-b291-96667e439dab req-4866d267-1d9f-4233-9ddc-92cc82ad9cb0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:13.655234 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-442eec0c-f2be-4914-b291-96667e439dab req-4866d267-1d9f-4233-9ddc-92cc82ad9cb0 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:13.667055 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-442eec0c-f2be-4914-b291-96667e439dab req-4866d267-1d9f-4233-9ddc-92cc82ad9cb0 service nova] Creating event network-changed:25b74d77-0925-42e3-828e-9877fbf74b6a for instance 29a29e05-e5eb-42e3-8e3b-a822ab67db2e on hv-cinder-77819 Nov 25 08:48:13.672989 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-442eec0c-f2be-4914-b291-96667e439dab req-4866d267-1d9f-4233-9ddc-92cc82ad9cb0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039979 Nov 25 08:48:13.677290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 563/1139] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:48:13.691823 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:13.700109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:13.702274 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:13.703634 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d47fb87c-818e-4350-ace6-d78242966a3d tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.349279 Nov 25 08:48:13.709312 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 577/1140] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:48:13 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:48:14.729493 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:14.731125 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:14.738304 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:14.738771 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:14.739779 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:14.740217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:14.983485 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:14.992028 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:14.993905 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ca11853c4c45cb8d845bb83b86899c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af706c5a572d4008b111a87e96ebf814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:48:14.995268 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-1902b330-9d15-48a1-8a28-488fb2352349 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 200 len: 1722 microversion: 2.20 time: 0.270410 Nov 25 08:48:14.996029 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 564/1141] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:48:14 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 25 08:48:15.406815 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-e353c5a1-5c4d-4406-980e-ec9b2e343d50 req-aadf181d-e4f9-487a-8c41-6152a9ba55dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf899124-0fb5-489e-a87e-f94a838091d7", "name": "network-vif-deleted", "tag": "358bd9c3-fe7c-46ac-9c3c-82e4369e8f66"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:48:15.408635 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:48:15.408635 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:48:15.416983 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-e353c5a1-5c4d-4406-980e-ec9b2e343d50 req-aadf181d-e4f9-487a-8c41-6152a9ba55dd service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:15.417680 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-e353c5a1-5c4d-4406-980e-ec9b2e343d50 req-aadf181d-e4f9-487a-8c41-6152a9ba55dd service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:15.434344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-e353c5a1-5c4d-4406-980e-ec9b2e343d50 req-aadf181d-e4f9-487a-8c41-6152a9ba55dd service nova] Creating event network-vif-deleted:358bd9c3-fe7c-46ac-9c3c-82e4369e8f66 for instance bf899124-0fb5-489e-a87e-f94a838091d7 on hv-cinder-77819 Nov 25 08:48:15.446314 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-e353c5a1-5c4d-4406-980e-ec9b2e343d50 req-aadf181d-e4f9-487a-8c41-6152a9ba55dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043562 Nov 25 08:48:15.446952 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 578/1142] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:16.015153 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:16.015904 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:16.022415 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:16.023190 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:16.024110 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:16.024741 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:16.039857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] HTTP exception thrown: Instance bf899124-0fb5-489e-a87e-f94a838091d7 could not be found. Nov 25 08:48:16.040719 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Returning 404 to user: Instance bf899124-0fb5-489e-a87e-f94a838091d7 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:48:16.041765 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-82a8c46b-a0ec-43dd-83e2-7929136cc2a2 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 404 len: 111 microversion: 2.20 time: 0.031314 Nov 25 08:48:16.042401 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 565/1143] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Nov 25 08:48:16 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 25 08:48:16.051639 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e78d2c2e-9cf4-4668-99b1-c27b7ce827ad tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '.version_select at 0x7f9708779e50>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:16.071977 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e78d2c2e-9cf4-4668-99b1-c27b7ce827ad tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749487841" status: 204 len: 0 microversion: 2.20 time: 0.024277 Nov 25 08:48:16.072762 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 579/1144] 10.222.0.46 () {60 vars in 1258 bytes} [Thu Nov 25 08:48:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749487841 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 25 08:48:17.913945 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:17.914458 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:17.921352 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:17.921799 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:17.922579 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:17.923042 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:17.937147 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] HTTP exception thrown: Instance bf899124-0fb5-489e-a87e-f94a838091d7 could not be found. Nov 25 08:48:17.937767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Returning 404 to user: Instance bf899124-0fb5-489e-a87e-f94a838091d7 could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:48:17.938584 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-b39af7c9-6982-4e51-ba95-ceb9d0865b12 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 404 len: 111 microversion: 2.1 time: 0.028394 Nov 25 08:48:17.939110 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 566/1145] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:48:17 2021] DELETE /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:48:17.947653 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:17.948385 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: bf899124-0fb5-489e-a87e-f94a838091d7] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:17.955616 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:17.956067 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:17.956840 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:17.957288 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:17.970329 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] HTTP exception thrown: Instance bf899124-0fb5-489e-a87e-f94a838091d7 could not be found. Nov 25 08:48:17.970914 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Returning 404 to user: Instance bf899124-0fb5-489e-a87e-f94a838091d7 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:48:17.971766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0b8fbf2a-a00c-4431-a652-265df1aaa5ab tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7" status: 404 len: 111 microversion: 2.1 time: 0.028612 Nov 25 08:48:17.972306 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 580/1146] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:17 2021] GET /compute/v2.1/servers/bf899124-0fb5-489e-a87e-f94a838091d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:48:19.103164 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:19.103737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:19.110786 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:19.111232 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:19.112047 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:19.112483 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:19.126286 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] HTTP exception thrown: Instance 861e5c47-a03f-44f8-8181-954812e9b38b could not be found. Nov 25 08:48:19.126865 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Returning 404 to user: Instance 861e5c47-a03f-44f8-8181-954812e9b38b could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:48:19.127709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2da624a9-9b9e-4b69-b540-235dfbce8159 tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 404 len: 111 microversion: 2.1 time: 0.028236 Nov 25 08:48:19.128241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 567/1147] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:48:19 2021] DELETE /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:48:19.135953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:19.136561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] [instance: 861e5c47-a03f-44f8-8181-954812e9b38b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:48:19.142863 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:19.143309 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:19.144122 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:48:19.144560 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:48:19.157755 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] HTTP exception thrown: Instance 861e5c47-a03f-44f8-8181-954812e9b38b could not be found. Nov 25 08:48:19.158335 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] Returning 404 to user: Instance 861e5c47-a03f-44f8-8181-954812e9b38b could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:48:19.159138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b8267a2d-dc68-4c32-a42e-500546f8e95c tempest-AttachVolumeShelveTestJSON-407224646 tempest-AttachVolumeShelveTestJSON-407224646-project] 10.222.0.46 "GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b" status: 404 len: 111 microversion: 2.1 time: 0.026860 Nov 25 08:48:19.159703 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 581/1148] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:48:19 2021] GET /compute/v2.1/servers/861e5c47-a03f-44f8-8181-954812e9b38b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:48:25.687247 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-63388597-dbb6-48ac-9a03-3f9c33a29627 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f9708677700>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:25.740953 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-63388597-dbb6-48ac-9a03-3f9c33a29627 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2c2e991d-327f-4fdb-a5ea-f04f2b86e193" status: 200 len: 351 microversion: 2.1 time: 0.057985 Nov 25 08:48:25.741516 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 568/1149] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:48:25 2021] GET /compute/v2.1/os-volumes/2c2e991d-327f-4fdb-a5ea-f04f2b86e193 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:27.057846 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3fa85ae6-0a71-4228-a9dc-8726d049a6a8 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f97086db0d0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:27.105183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3fa85ae6-0a71-4228-a9dc-8726d049a6a8 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/eebd7524-6e7f-471e-8ba8-137a3f5eb54a" status: 200 len: 351 microversion: 2.1 time: 0.050844 Nov 25 08:48:27.105782 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 582/1150] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:48:27 2021] GET /compute/v2.1/os-volumes/eebd7524-6e7f-471e-8ba8-137a3f5eb54a => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:28.428161 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-928c2931-4dbd-419f-844f-267a8b27ad29 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f970874a3a0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:28.474963 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-928c2931-4dbd-419f-844f-267a8b27ad29 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/76b8aab9-4906-4efb-8ac7-157d32285f75" status: 200 len: 351 microversion: 2.1 time: 0.050988 Nov 25 08:48:28.475523 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 569/1151] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Nov 25 08:48:28 2021] GET /compute/v2.1/os-volumes/76b8aab9-4906-4efb-8ac7-157d32285f75 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:28.487606 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-85b91d8a-f1b8-4953-b192-9358d7c4f4f2 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f9708779f70>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:28.572509 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-85b91d8a-f1b8-4953-b192-9358d7c4f4f2 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088983 Nov 25 08:48:28.573153 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 583/1152] 10.222.0.46 () {58 vars in 1133 bytes} [Thu Nov 25 08:48:28 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:28.585313 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fec93776-c3dc-4310-8e77-5ed129a3c6b5 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f970849eaf0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:28.671378 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fec93776-c3dc-4310-8e77-5ed129a3c6b5 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089596 Nov 25 08:48:28.671981 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 570/1153] 10.222.0.46 () {58 vars in 1148 bytes} [Thu Nov 25 08:48:28 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:28.689048 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2e04e86e-0138-4467-9395-a249d7e5c1d8 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f970858f5e0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:28.772354 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2e04e86e-0138-4467-9395-a249d7e5c1d8 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088141 Nov 25 08:48:28.772919 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 584/1154] 10.222.0.46 () {58 vars in 1133 bytes} [Thu Nov 25 08:48:28 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:28.784575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-09febab9-e61d-461f-9c24-0f0885278d38 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f97088bc5e0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:28.867098 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-09febab9-e61d-461f-9c24-0f0885278d38 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086135 Nov 25 08:48:28.867873 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 571/1155] 10.222.0.46 () {58 vars in 1166 bytes} [Thu Nov 25 08:48:28 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:28.879028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8953c335-b657-4463-8ce1-9162aeb4d3f9 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f97085319d0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:28.963983 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8953c335-b657-4463-8ce1-9162aeb4d3f9 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088263 Nov 25 08:48:28.964559 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 585/1156] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Nov 25 08:48:28 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:28.977044 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6cfc5e44-7cc6-49d1-b023-61caf477d500 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f970874a670>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:29.068623 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6cfc5e44-7cc6-49d1-b023-61caf477d500 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.095163 Nov 25 08:48:29.069196 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 572/1157] 10.222.0.46 () {58 vars in 1154 bytes} [Thu Nov 25 08:48:28 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:48:29.081553 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-79641e17-eeb8-40cb-93cc-0da848c0ad24 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f97088093a0>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:29.182561 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-79641e17-eeb8-40cb-93cc-0da848c0ad24 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104911 Nov 25 08:48:29.183137 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 586/1158] 10.222.0.46 () {58 vars in 1187 bytes} [Thu Nov 25 08:48:29 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:48:29.194438 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d3eb8440-5191-47c7-90bf-801f7d360b80 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] Calling method '.version_select at 0x7f97085bb5e0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:48:29.288617 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d3eb8440-5191-47c7-90bf-801f7d360b80 tempest-VolumesTestJSON-382144649 tempest-VolumesTestJSON-382144649-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.097512 Nov 25 08:48:29.289426 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 573/1159] 10.222.0.46 () {58 vars in 1154 bytes} [Thu Nov 25 08:48:29 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:19.782984 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-3e94ec2e-6151-4702-86b4-0dd698afa636 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Action: 'create', calling method: .version_select at 0x7f9708531430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1071915280"}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:49:19.797423 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-3e94ec2e-6151-4702-86b4-0dd698afa636 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Getting quotas for project 3f30271e57434c7bb827ede7add0c04b. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:49:19.801487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-3e94ec2e-6151-4702-86b4-0dd698afa636 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Getting quotas for user 395156b79c794b13a07835c721de971d and project 3f30271e57434c7bb827ede7add0c04b. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:49:19.958200 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-3e94ec2e-6151-4702-86b4-0dd698afa636 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Getting quotas for project 3f30271e57434c7bb827ede7add0c04b. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:49:19.963133 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.quota [None req-3e94ec2e-6151-4702-86b4-0dd698afa636 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Getting quotas for user 395156b79c794b13a07835c721de971d and project 3f30271e57434c7bb827ede7add0c04b. Resources: {'key_pairs'} {{(pid=122641) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:49:19.979358 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-3e94ec2e-6151-4702-86b4-0dd698afa636 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.388953 Nov 25 08:49:19.980113 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 587/1160] 10.222.0.46 () {60 vars in 1157 bytes} [Thu Nov 25 08:49:19 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:46.700794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-696589686", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1071915280", "security_groups": [{"name": "tempest-secgroup-smoke-1363230855"}], "networks": [{"uuid": "8c800b04-d4c8-4974-9ff7-6a175a69e904"}], "block_device_mapping_v2": [{"uuid": "6f574a14-9a0c-4c00-a02b-de6719cbc1ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:49:46.822429 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.network.neutron [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] validate_networks() for [('8c800b04-d4c8-4974-9ff7-6a175a69e904', None, None, None, None, None)] {{(pid=122643) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 25 08:49:47.203528 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Flavor limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 25 08:49:47.203971 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Image limits 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 25 08:49:47.204443 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Flavor pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 25 08:49:47.204842 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Image pref 0:0:0 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 25 08:49:47.205257 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.virt.hardware [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 25 08:49:47.214671 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:47.215119 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:47.215980 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:47.216417 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:47.234626 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Getting quotas for project 3f30271e57434c7bb827ede7add0c04b. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 25 08:49:47.238987 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.quota [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Getting quotas for user 395156b79c794b13a07835c721de971d and project 3f30271e57434c7bb827ede7add0c04b. Resources: {'instances', 'ram', 'cores'} {{(pid=122643) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 25 08:49:47.296843 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Going to run 1 instances... {{(pid=122643) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 25 08:49:47.298976 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f574a14-9a0c-4c00-a02b-de6719cbc1ec',volume_size=None,volume_type=None)] {{(pid=122643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 25 08:49:47.418767 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [dd8df86d-5e53-4492-abb5-d9da4f6601d5] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 25 08:49:48.437396 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO oslo.messaging._drivers.impl_rabbit [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [dd8df86d-5e53-4492-abb5-d9da4f6601d5] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41080. Nov 25 08:49:48.441735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-0ce3347a-9495-40b1-8f0e-c92d10904c65 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.747553 Nov 25 08:49:48.442374 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 574/1161] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Nov 25 08:49:46 2021] POST /compute/v2.1/servers => generated 406 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 25 08:49:48.453015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-64a1344b-fdb1-4b91-82e8-ac548b30122d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:48.453681 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-64a1344b-fdb1-4b91-82e8-ac548b30122d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:48.507058 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-64a1344b-fdb1-4b91-82e8-ac548b30122d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:48.514373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-64a1344b-fdb1-4b91-82e8-ac548b30122d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1088 microversion: 2.1 time: 0.065574 Nov 25 08:49:48.514902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 588/1162] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:48 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:49.531482 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-59f0ff87-f86b-438a-a826-85c7c67f07cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:49.532148 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-59f0ff87-f86b-438a-a826-85c7c67f07cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:49.583303 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-59f0ff87-f86b-438a-a826-85c7c67f07cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:49.589835 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-59f0ff87-f86b-438a-a826-85c7c67f07cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1088 microversion: 2.1 time: 0.062984 Nov 25 08:49:49.590450 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 575/1163] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:49 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1088 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:50.607027 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2383b249-243d-4734-bb65-c69f495d4f8a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:50.609669 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2383b249-243d-4734-bb65-c69f495d4f8a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:50.664776 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2383b249-243d-4734-bb65-c69f495d4f8a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:50.672727 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2383b249-243d-4734-bb65-c69f495d4f8a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1088 microversion: 2.1 time: 0.069458 Nov 25 08:49:50.673290 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 589/1164] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:50 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:51.690267 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-52722400-f8cd-4791-b54b-1ecc801d4dbf tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:51.690849 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-52722400-f8cd-4791-b54b-1ecc801d4dbf tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:51.749901 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-52722400-f8cd-4791-b54b-1ecc801d4dbf tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:51.759353 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-52722400-f8cd-4791-b54b-1ecc801d4dbf tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1088 microversion: 2.1 time: 0.072972 Nov 25 08:49:51.760682 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 576/1165] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:51 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:52.782411 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:52.783224 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:52.791658 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:52.792373 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:52.793661 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:52.794193 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:52.857512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:52.865538 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-52a95207-9378-4a78-952a-04f226d5fb9b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1138 microversion: 2.1 time: 0.088270 Nov 25 08:49:52.866106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 590/1166] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:52 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:53.882489 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:53.883133 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:53.890463 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:53.890930 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:53.891732 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:53.892159 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:53.973936 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:53.981393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-272fb736-f5d6-4334-a3a3-059d2bad994d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1204 microversion: 2.1 time: 0.102995 Nov 25 08:49:53.981957 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 577/1167] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:53 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:54.975404 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-51456654-6711-4d86-8149-68977aba1b15 req-75121cb8-baab-4044-ac75-55a33a94f183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9253a3-5d37-4a9e-b18b-999abafb8b56", "tag": "db687506-7dd4-4b8c-86c1-cb18b70d4715"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:49:54.977168 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:49:54.977168 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:49:54.986457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-51456654-6711-4d86-8149-68977aba1b15 req-75121cb8-baab-4044-ac75-55a33a94f183 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:55.003180 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:55.003701 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:55.012213 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-51456654-6711-4d86-8149-68977aba1b15 req-75121cb8-baab-4044-ac75-55a33a94f183 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:55.020305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:55.020967 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:55.021806 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:55.022270 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:55.028369 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-51456654-6711-4d86-8149-68977aba1b15 req-75121cb8-baab-4044-ac75-55a33a94f183 service nova] Creating event network-changed:db687506-7dd4-4b8c-86c1-cb18b70d4715 for instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 on hv-cinder-77819 Nov 25 08:49:55.034252 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-51456654-6711-4d86-8149-68977aba1b15 req-75121cb8-baab-4044-ac75-55a33a94f183 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063983 Nov 25 08:49:55.035345 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 591/1168] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:49:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:49:55.246584 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:55.253857 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-5dfaaa69-b4ea-4901-87f1-e2ef3315db76 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.258404 Nov 25 08:49:55.254420 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 578/1169] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:54 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:49:56.272307 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:56.272991 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:56.278934 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:56.279431 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:56.280499 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:56.280935 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:56.421866 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:56.429361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-e6e9a899-52a2-46b8-a1ba-da27bc72400b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.161444 Nov 25 08:49:56.429938 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 592/1170] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:56 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:57.447240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:57.447892 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:57.454018 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:57.454457 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:57.455228 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:57.455708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:57.588708 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:57.596524 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-459018ff-5744-4f71-989a-f5dcfa4dcc3b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.153135 Nov 25 08:49:57.597098 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 579/1171] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:57 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:58.613243 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:58.613857 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:58.620175 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:58.620627 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:58.621412 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:58.621850 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:58.751857 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:58.759343 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-a9a1bd3a-8533-4faa-b790-24dad7a993c5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.149711 Nov 25 08:49:58.759933 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 593/1172] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:58 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:49:59.776935 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:49:59.777570 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:49:59.783866 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:59.784317 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:59.785087 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:49:59.785520 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:49:59.921920 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:49:59.929217 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-560d2125-3e0e-433b-9fe9-529ed3759b9c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.155977 Nov 25 08:49:59.929794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 580/1173] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:49:59 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:00.946317 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:00.946918 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:00.954058 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:00.954502 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:00.955270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:00.955729 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:01.088235 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:01.095518 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-dafb5d89-71b9-4739-9422-514501756e80 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.153064 Nov 25 08:50:01.096106 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 594/1174] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:00 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:02.113581 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:02.114206 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:02.120627 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:02.121086 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:02.121875 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:02.122312 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:02.362608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:02.369784 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9608503e-3ecb-4981-93b6-14486eb479ea tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.260655 Nov 25 08:50:02.370354 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 581/1175] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:02 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:02.884685 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:02.885313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:02.886697 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-3d01e7f8-39d3-4e3f-882e-03c738b8e306 req-ed68f23d-5604-47d5-90d3-a6731c281a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a29e05-e5eb-42e3-8e3b-a822ab67db2e", "tag": "25b74d77-0925-42e3-828e-9877fbf74b6a"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:50:02.888491 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:50:02.888491 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:50:02.892232 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:02.893445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:02.894765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:02.895375 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:02.896100 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-3d01e7f8-39d3-4e3f-882e-03c738b8e306 req-ed68f23d-5604-47d5-90d3-a6731c281a83 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:02.896575 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-3d01e7f8-39d3-4e3f-882e-03c738b8e306 req-ed68f23d-5604-47d5-90d3-a6731c281a83 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:02.911175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-3d01e7f8-39d3-4e3f-882e-03c738b8e306 req-ed68f23d-5604-47d5-90d3-a6731c281a83 service nova] Creating event network-changed:25b74d77-0925-42e3-828e-9877fbf74b6a for instance 29a29e05-e5eb-42e3-8e3b-a822ab67db2e on hv-cinder-77819 Nov 25 08:50:02.916654 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-3d01e7f8-39d3-4e3f-882e-03c738b8e306 req-ed68f23d-5604-47d5-90d3-a6731c281a83 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033434 Nov 25 08:50:02.917789 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 582/1176] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:50:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:50:02.925245 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:50:03.007897 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-dfd776ca-f0e1-4b8c-8f92-aec7db3d2ff6 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "DELETE /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 204 len: 0 microversion: 2.1 time: 0.126463 Nov 25 08:50:03.009377 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 595/1177] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:50:02 2021] DELETE /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:50:03.018549 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:03.019238 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:03.026641 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:03.027091 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:03.027911 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:03.028343 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:03.387757 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:03.388670 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:03.397780 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:03.398490 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:03.399361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:03.400031 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:03.539262 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:03.548760 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-41b0b3eb-fb8c-41a6-b8d9-a180560da42e tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1577 microversion: 2.1 time: 0.534266 Nov 25 08:50:03.549432 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 583/1178] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:03 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1577 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:03.647208 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:03.655928 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-4bdf019f-b225-4282-92e8-3256ea922c0c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.272607 Nov 25 08:50:03.656899 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 596/1179] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:03 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:50:04.566650 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:04.567264 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:04.573999 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:04.574442 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:04.575224 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:04.575717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:04.671970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:04.672580 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:04.678870 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:04.679315 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:04.681022 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:04.681636 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:04.716266 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:04.724324 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6822f997-00df-4514-b6c7-c98989c33061 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1458 microversion: 2.1 time: 0.161316 Nov 25 08:50:04.725220 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 584/1180] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:04 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:04.832675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:04.840045 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d9549c01-d00b-41b2-ab32-67a908549f0b tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.171994 Nov 25 08:50:04.840711 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 597/1181] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:04 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 25 08:50:05.580444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-182409d4-90b0-45db-9bfd-7f1678090219 req-5f7572b4-a922-414f-9b06-74b3640ecdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a29e05-e5eb-42e3-8e3b-a822ab67db2e", "name": "network-vif-deleted", "tag": "25b74d77-0925-42e3-828e-9877fbf74b6a"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:50:05.581948 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:50:05.581948 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:50:05.589222 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-182409d4-90b0-45db-9bfd-7f1678090219 req-5f7572b4-a922-414f-9b06-74b3640ecdc2 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:05.589663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-182409d4-90b0-45db-9bfd-7f1678090219 req-5f7572b4-a922-414f-9b06-74b3640ecdc2 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:05.600974 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-182409d4-90b0-45db-9bfd-7f1678090219 req-5f7572b4-a922-414f-9b06-74b3640ecdc2 service nova] Creating event network-vif-deleted:25b74d77-0925-42e3-828e-9877fbf74b6a for instance 29a29e05-e5eb-42e3-8e3b-a822ab67db2e on hv-cinder-77819 Nov 25 08:50:05.605951 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-182409d4-90b0-45db-9bfd-7f1678090219 req-5f7572b4-a922-414f-9b06-74b3640ecdc2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029115 Nov 25 08:50:05.606468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 585/1182] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:50:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:50:05.742749 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:05.743355 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:05.751953 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:05.752398 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:05.753179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:05.753612 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:05.815745 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:05.823416 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-d3e4c7d8-6037-4b3f-9738-af919394ae91 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 200 len: 1225 microversion: 2.1 time: 0.085516 Nov 25 08:50:05.824066 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 598/1183] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:05 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:05.859735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:05.860461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:05.867143 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:05.867651 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:05.868645 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:05.869244 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:06.018404 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:06.026143 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-9ba72c6b-aca4-4046-82b9-04c99b57efed tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.171554 Nov 25 08:50:06.026717 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 586/1184] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:05 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:06.840512 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:06.841236 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: 29a29e05-e5eb-42e3-8e3b-a822ab67db2e] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:06.847760 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:06.848211 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:06.849017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:06.849452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:06.862710 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] HTTP exception thrown: Instance 29a29e05-e5eb-42e3-8e3b-a822ab67db2e could not be found. Nov 25 08:50:06.863425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Returning 404 to user: Instance 29a29e05-e5eb-42e3-8e3b-a822ab67db2e could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:50:06.864285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0c9c6d1b-4785-41b1-a771-1aef8aaa3ac4 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e" status: 404 len: 111 microversion: 2.1 time: 0.027536 Nov 25 08:50:06.864836 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 599/1185] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:06 2021] GET /compute/v2.1/servers/29a29e05-e5eb-42e3-8e3b-a822ab67db2e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:50:06.879435 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-dafcf602-3827-4c53-8577-6675205e4512 req-4b3d66f0-0b94-4b2b-96c5-b91fb2086537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9253a3-5d37-4a9e-b18b-999abafb8b56", "name": "network-vif-plugged", "status": "completed", "tag": "db687506-7dd4-4b8c-86c1-cb18b70d4715"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:50:06.881645 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:50:06.881645 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:50:06.889859 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-dafcf602-3827-4c53-8577-6675205e4512 req-4b3d66f0-0b94-4b2b-96c5-b91fb2086537 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:06.890889 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-dafcf602-3827-4c53-8577-6675205e4512 req-4b3d66f0-0b94-4b2b-96c5-b91fb2086537 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:06.905811 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-dafcf602-3827-4c53-8577-6675205e4512 req-4b3d66f0-0b94-4b2b-96c5-b91fb2086537 service nova] Creating event network-vif-plugged:db687506-7dd4-4b8c-86c1-cb18b70d4715 for instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 on hv-cinder-77819 Nov 25 08:50:06.911106 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-dafcf602-3827-4c53-8577-6675205e4512 req-4b3d66f0-0b94-4b2b-96c5-b91fb2086537 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035300 Nov 25 08:50:06.912024 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 587/1186] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:50:07.048618 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:07.049766 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:07.063047 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:07.063997 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:07.069384 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:07.070169 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:07.255146 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:07.262787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-992a4323-a125-43f6-a493-9fa0bdb7f814 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.221852 Nov 25 08:50:07.263832 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 600/1187] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:07 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:08.280804 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:08.281444 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:08.288045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:08.288496 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:08.289285 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:08.289724 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:08.422938 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:08.430241 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-16b21f9d-b27c-4dc3-b16b-a651f3543127 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1260 microversion: 2.1 time: 0.153716 Nov 25 08:50:08.430815 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 588/1188] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:08 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:09.449028 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:09.449610 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:09.456741 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:09.457188 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:09.457970 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:09.458405 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:09.734877 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:09.742274 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-066be22a-e7ae-408c-9ab4-d40dbabd2b3a tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1444 microversion: 2.1 time: 0.296981 Nov 25 08:50:09.742839 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 601/1189] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:09 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1444 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:09.758986 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:09.759621 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:09.766627 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:09.767069 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:09.767880 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:09.768320 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:09.983899 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:09.992187 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-2d152c76-e7f1-4f73-b9a7-d83c57426df6 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1444 microversion: 2.1 time: 0.236773 Nov 25 08:50:09.992770 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 589/1190] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:09 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1444 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:10.074138 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:10.074518 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:10.077970 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-8e382413-1542-4dba-b6f9-05c7d1354200 req-9ad74402-9165-4cfa-8d0f-6ed4f2b3e61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b940ec-da83-47d2-81eb-2b12373a55ae", "tag": "a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:50:10.080480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:50:10.080480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:50:10.081410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:10.081874 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:10.082672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:10.083114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:10.089003 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-8e382413-1542-4dba-b6f9-05c7d1354200 req-9ad74402-9165-4cfa-8d0f-6ed4f2b3e61e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:10.089739 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-8e382413-1542-4dba-b6f9-05c7d1354200 req-9ad74402-9165-4cfa-8d0f-6ed4f2b3e61e service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:10.103985 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-8e382413-1542-4dba-b6f9-05c7d1354200 req-9ad74402-9165-4cfa-8d0f-6ed4f2b3e61e service nova] Creating event network-changed:a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf for instance d8b940ec-da83-47d2-81eb-2b12373a55ae on hv-cinder-77819 Nov 25 08:50:10.110515 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:50:10.112259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-8e382413-1542-4dba-b6f9-05c7d1354200 req-9ad74402-9165-4cfa-8d0f-6ed4f2b3e61e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038370 Nov 25 08:50:10.113959 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 590/1191] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:50:10.206291 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5d7e7881-7eed-48ee-ba45-bfdcfbc71975 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 204 len: 0 microversion: 2.1 time: 0.132752 Nov 25 08:50:10.207595 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 602/1192] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:50:10 2021] DELETE /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:50:10.216472 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:10.217240 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:10.224707 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:10.225510 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:10.225931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:10.226362 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:10.494988 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:10.506279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-34039f09-4a3e-4288-b963-75f84994e723 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1577 microversion: 2.1 time: 0.294144 Nov 25 08:50:10.507179 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 591/1193] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:10 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1577 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:11.524012 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:11.524718 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:11.531114 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:11.531565 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:11.532362 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:11.532790 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:11.672930 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:11.680650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-b1528842-85ef-4b29-8a24-61589f979c24 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1458 microversion: 2.1 time: 0.160664 Nov 25 08:50:11.681230 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 603/1194] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:11 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1458 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:11.893749 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-9b8689a2-3229-44f6-bcf5-7ca355b90109 req-9aa4db7e-44e0-4ced-a1e0-a7e77ba32e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9253a3-5d37-4a9e-b18b-999abafb8b56", "tag": "db687506-7dd4-4b8c-86c1-cb18b70d4715"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:50:11.895236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:50:11.895236 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:50:11.902588 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-9b8689a2-3229-44f6-bcf5-7ca355b90109 req-9aa4db7e-44e0-4ced-a1e0-a7e77ba32e70 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:11.903016 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-9b8689a2-3229-44f6-bcf5-7ca355b90109 req-9aa4db7e-44e0-4ced-a1e0-a7e77ba32e70 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:11.914817 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-9b8689a2-3229-44f6-bcf5-7ca355b90109 req-9aa4db7e-44e0-4ced-a1e0-a7e77ba32e70 service nova] Creating event network-changed:db687506-7dd4-4b8c-86c1-cb18b70d4715 for instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 on hv-cinder-77819 Nov 25 08:50:11.920225 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-9b8689a2-3229-44f6-bcf5-7ca355b90109 req-9aa4db7e-44e0-4ced-a1e0-a7e77ba32e70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029796 Nov 25 08:50:11.921427 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 592/1195] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:50:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:50:12.698078 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:12.698922 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:12.706112 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:12.706886 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:12.707728 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:12.708168 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:13.121838 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-82ae3c02-dd7e-4238-b069-d60eefd7eeaf req-41ebf39e-a836-4ec2-a0cb-11f22a1c33b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b940ec-da83-47d2-81eb-2b12373a55ae", "name": "network-vif-deleted", "tag": "a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:50:13.125361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:50:13.125361 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:50:13.134932 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-82ae3c02-dd7e-4238-b069-d60eefd7eeaf req-41ebf39e-a836-4ec2-a0cb-11f22a1c33b8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:13.138495 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a2f54eb10148c48a3cdd2641da5315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea2e5b2d558c4540ba188353dd3c27e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:50:13.142833 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-82ae3c02-dd7e-4238-b069-d60eefd7eeaf req-41ebf39e-a836-4ec2-a0cb-11f22a1c33b8 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:13.148748 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-78646a2e-8187-4bf4-84be-57c468a12d4d tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 200 len: 1458 microversion: 2.1 time: 0.453982 Nov 25 08:50:13.150252 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 604/1196] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:12 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 1458 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:50:13.160545 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-82ae3c02-dd7e-4238-b069-d60eefd7eeaf req-41ebf39e-a836-4ec2-a0cb-11f22a1c33b8 service nova] Creating event network-vif-deleted:a5ef865b-ae6c-41ec-b2e2-1e9e0f6831bf for instance d8b940ec-da83-47d2-81eb-2b12373a55ae on hv-cinder-77819 Nov 25 08:50:13.165858 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-82ae3c02-dd7e-4238-b069-d60eefd7eeaf req-41ebf39e-a836-4ec2-a0cb-11f22a1c33b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048856 Nov 25 08:50:13.167360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 593/1197] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:50:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:50:14.167550 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:14.168178 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: d8b940ec-da83-47d2-81eb-2b12373a55ae] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:14.175083 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:14.175523 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:14.176324 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:14.176758 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:14.190361 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] HTTP exception thrown: Instance d8b940ec-da83-47d2-81eb-2b12373a55ae could not be found. Nov 25 08:50:14.191140 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Returning 404 to user: Instance d8b940ec-da83-47d2-81eb-2b12373a55ae could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:50:14.192089 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-eef7888a-6a82-4dee-8c04-699470eb67f5 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae" status: 404 len: 111 microversion: 2.1 time: 0.028131 Nov 25 08:50:14.192625 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 605/1198] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:14 2021] GET /compute/v2.1/servers/d8b940ec-da83-47d2-81eb-2b12373a55ae => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:50:14.645691 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:14.646265 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:14.652285 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:14.652735 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:14.653525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:14.654562 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:14.667349 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.wsgi [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] HTTP exception thrown: Instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b could not be found. Nov 25 08:50:14.668019 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Returning 404 to user: Instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b could not be found. {{(pid=122643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:50:14.668829 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bd007530-0638-466a-9592-f7ac8ffffd71 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 404 len: 111 microversion: 2.1 time: 0.028327 Nov 25 08:50:14.669393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 594/1199] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:50:14 2021] DELETE /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:50:14.677652 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:14.678259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] [instance: dee504ef-51bf-44f8-a9a2-222f68d2cd9b] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:50:14.684007 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:14.684445 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:14.685343 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:50:14.685861 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:50:14.698698 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] HTTP exception thrown: Instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b could not be found. Nov 25 08:50:14.699269 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Returning 404 to user: Instance dee504ef-51bf-44f8-a9a2-222f68d2cd9b could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:50:14.700101 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-84f8f9e0-bf89-413d-8e86-0abfefdca9f2 tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b" status: 404 len: 111 microversion: 2.1 time: 0.026170 Nov 25 08:50:14.701313 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 606/1200] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:50:14 2021] GET /compute/v2.1/servers/dee504ef-51bf-44f8-a9a2-222f68d2cd9b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:50:15.978368 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-c17d7344-e531-47a0-8acf-d468024b68ae tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] Calling method '.version_select at 0x7f97086571f0>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:50:15.999850 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-c17d7344-e531-47a0-8acf-d468024b68ae tempest-TestVolumeBootPattern-6397733 tempest-TestVolumeBootPattern-6397733-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-739661517" status: 202 len: 0 microversion: 2.1 time: 0.025080 Nov 25 08:50:16.000778 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 595/1201] 10.222.0.46 () {58 vars in 1259 bytes} [Thu Nov 25 08:50:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-739661517 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:50:22.307109 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:50:22.307722 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:50:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:52:10.359672 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3fa22368-1f09-4240-bac5-f5e5bc7fa980] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 25 08:52:10.363128 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:52:10.363707 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:10.370279 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:10.370735 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:10.371513 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:10.371982 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:10.393847 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.objects.instance [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lazy-loading 'flavor' on Instance uuid 3c9253a3-5d37-4a9e-b18b-999abafb8b56 {{(pid=122641) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 25 08:52:10.466160 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-67192e8c-4716-4462-bc87-ab8303268d2e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "POST /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56/action" status: 202 len: 0 microversion: 2.1 time: 0.108600 Nov 25 08:52:10.466768 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 607/1202] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:52:10 2021] POST /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:52:10.472859 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fed55f0f-4a87-4507-bab7-8ae0772d26bf] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 25 08:52:10.476749 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:10.477358 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:10.484551 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:10.485045 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:10.485945 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:10.486342 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:10.737737 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:10.746130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-360bc5f2-03d7-477a-a81e-ffef2cb846d1 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.275039 Nov 25 08:52:10.746694 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 596/1203] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:10 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:11.773740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:11.774425 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:11.781384 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:11.781827 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:11.782589 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:11.783012 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:11.786344 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] [3fa22368-1f09-4240-bac5-f5e5bc7fa980] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41350. Nov 25 08:52:11.967323 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:11.974806 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8f2f6c59-8546-4caf-b4eb-03dd9db835a4 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.215138 Nov 25 08:52:11.975364 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 608/1204] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:11 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:12.992203 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:12.992794 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:13.014814 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO oslo.messaging._drivers.impl_rabbit [-] [fed55f0f-4a87-4507-bab7-8ae0772d26bf] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41356. Nov 25 08:52:13.016227 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:13.016670 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:13.017451 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:13.017916 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:13.150290 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:13.157617 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-42f85e3a-8f34-4460-84ce-d862eb12f4ad tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.169115 Nov 25 08:52:13.158175 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 597/1205] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:12 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:14.175058 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:14.175625 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:14.181765 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:14.182880 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:14.183681 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:14.184110 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:14.316544 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:14.324231 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7942563a-cc56-4a33-9978-1f47b9054782 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.152792 Nov 25 08:52:14.325056 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 609/1206] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:14 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:15.342019 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:15.342686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:15.349085 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:15.349532 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:15.350306 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:15.350739 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:15.484530 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:15.492259 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-728ee06d-eeed-4c7d-ab58-b91d7116b5d5 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.154349 Nov 25 08:52:15.492838 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 598/1207] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:15 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:16.510185 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:16.510787 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:16.517493 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:16.517931 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:16.518704 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:16.519134 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:16.667772 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:16.675124 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2c07391a-18e0-4940-a902-13ec391de2f7 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.168698 Nov 25 08:52:16.675720 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 610/1208] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:16 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:17.693684 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:17.694393 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:17.701856 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:17.702338 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:17.703130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:17.703586 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:17.840130 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:17.847992 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-d1a91ca4-f5e2-40ce-bccd-051bc088ca19 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.157845 Nov 25 08:52:17.848565 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 599/1209] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:17 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:18.864714 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:18.865270 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:18.871981 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:18.872430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:18.873200 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:18.873640 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:19.009588 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:19.017351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-5876f381-8b24-4aff-b9c3-2acc380de485 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.156362 Nov 25 08:52:19.023660 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 611/1210] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:18 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:20.035103 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:20.035738 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:20.042699 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:20.043136 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:20.043952 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:20.044392 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:20.185912 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:20.193461 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-fb636f51-3742-4b0c-aefe-1da666b4ece2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.162093 Nov 25 08:52:20.194025 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 600/1211] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:20 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:21.211142 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:21.211800 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:21.218721 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:21.219165 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:21.219993 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:21.220430 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:21.374912 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:21.382450 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-947b6347-7876-49d0-b3b9-6c8414b2d4ac tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.174924 Nov 25 08:52:21.383017 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 612/1212] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:21 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:22.399650 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:22.400318 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:22.407083 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:22.407525 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:22.408337 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:22.408781 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:22.548663 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:22.556106 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-50488267-dd42-4f8d-b53f-059985a448cc tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.160211 Nov 25 08:52:22.556668 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 601/1213] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:22 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:23.573095 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:23.573655 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:23.581005 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:23.581497 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:23.582293 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:23.582725 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:23.728018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:23.736308 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-54021113-0f55-4ba2-873c-d38eb3525e26 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.166853 Nov 25 08:52:23.736889 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 613/1214] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:23 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:24.753172 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:24.753788 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:24.760115 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:24.760557 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:24.761338 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:24.762483 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:24.907437 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:24.918209 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-bd9d263f-23d9-42d4-959f-0808e1dfa50e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1508 microversion: 2.1 time: 0.168300 Nov 25 08:52:24.919184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 602/1215] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:24 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:24.937201 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-489abc60-a3c6-4892-8847-a4fb3a9fb340 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:52:24.937793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-489abc60-a3c6-4892-8847-a4fb3a9fb340 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:24.944053 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-489abc60-a3c6-4892-8847-a4fb3a9fb340 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:24.944495 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-489abc60-a3c6-4892-8847-a4fb3a9fb340 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:24.945280 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-489abc60-a3c6-4892-8847-a4fb3a9fb340 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:24.945714 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-489abc60-a3c6-4892-8847-a4fb3a9fb340 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:25.023152 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-489abc60-a3c6-4892-8847-a4fb3a9fb340 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "POST /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56/action" status: 202 len: 0 microversion: 2.1 time: 0.090266 Nov 25 08:52:25.024015 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 614/1216] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Nov 25 08:52:24 2021] POST /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:52:25.032208 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:25.032813 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:25.038569 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:25.039013 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:25.039844 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:25.040338 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:25.187468 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:25.195253 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-423e1ba2-ebf6-49de-8b6c-8be2be452e3e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1516 microversion: 2.1 time: 0.167010 Nov 25 08:52:25.196005 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 603/1217] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:25 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:26.140087 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:52:26.140675 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:52:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:52:26.213976 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:26.214502 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:26.221692 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:26.222175 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:26.223083 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:26.225198 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:26.363379 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:26.370734 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-0e93dc95-8901-437d-9527-5d53fe126e23 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.161128 Nov 25 08:52:26.372072 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 615/1218] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:26 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:27.389040 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:27.389658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:27.396659 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:27.397111 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:27.397903 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:27.398339 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:27.493800 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-f9985611-866c-4ffc-b23e-74ab65ba0291 req-cee7418c-4085-4ebc-ab7c-766442ca0046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9253a3-5d37-4a9e-b18b-999abafb8b56", "name": "network-vif-unplugged", "status": "completed", "tag": "db687506-7dd4-4b8c-86c1-cb18b70d4715"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:52:27.495351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:52:27.495351 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:52:27.503483 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-f9985611-866c-4ffc-b23e-74ab65ba0291 req-cee7418c-4085-4ebc-ab7c-766442ca0046 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:27.504237 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-f9985611-866c-4ffc-b23e-74ab65ba0291 req-cee7418c-4085-4ebc-ab7c-766442ca0046 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:27.517485 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-f9985611-866c-4ffc-b23e-74ab65ba0291 req-cee7418c-4085-4ebc-ab7c-766442ca0046 service nova] Creating event network-vif-unplugged:db687506-7dd4-4b8c-86c1-cb18b70d4715 for instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 on hv-cinder-77819 Nov 25 08:52:27.522945 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-f9985611-866c-4ffc-b23e-74ab65ba0291 req-cee7418c-4085-4ebc-ab7c-766442ca0046 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097542 Nov 25 08:52:27.523585 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 616/1219] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:52:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:52:27.552123 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:27.560808 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-61db99ce-4858-4f13-b5c1-69d638f513c3 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.175473 Nov 25 08:52:27.561385 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 604/1220] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:27 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:28.578526 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:28.579210 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:28.585250 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:28.585687 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:28.586457 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:28.586890 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:28.719033 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:28.726381 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7838dbee-3468-4bf8-86b9-196d14a8d56d tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.152742 Nov 25 08:52:28.726944 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 617/1221] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:28 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:29.743953 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:29.744571 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:29.751184 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:29.751667 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:29.752486 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:29.752923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:29.887248 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:29.895252 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6a2515d6-ce89-4310-a2f2-344e83589c09 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.154970 Nov 25 08:52:29.895851 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 605/1222] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:29 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:30.913810 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:30.914418 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:30.920958 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:30.921410 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:30.922187 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:30.922622 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:31.052505 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:31.059894 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-6cd0f0b0-bc39-4e89-ac28-658cc90801ab tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.149948 Nov 25 08:52:31.060454 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 618/1223] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:30 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:32.078157 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:32.078757 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:32.085039 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:32.085480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:32.086253 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:32.086680 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:32.221985 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:32.229371 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-237d6ca1-30a1-44ef-8f91-1565371dcf94 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.155757 Nov 25 08:52:32.229931 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 606/1224] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:32 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:33.247123 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:33.248831 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:33.256219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:33.256664 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:33.257438 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:33.257870 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:33.437535 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:33.444895 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-8885f6c2-f7b5-45ad-8b4d-125cd4c7b5d0 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.202051 Nov 25 08:52:33.445469 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 619/1225] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:33 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:34.462294 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:34.462914 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:34.469646 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:34.470094 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:34.470903 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:34.471331 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:34.856291 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:34.864408 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-112848f0-6373-4ab2-8fb8-8cc884f4c6db tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1574 microversion: 2.1 time: 0.405922 Nov 25 08:52:34.864965 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 607/1226] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:34 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1574 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:35.882219 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:52:35.882944 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:52:35.889890 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:35.890422 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:35.891271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:35.891809 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:36.024711 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:52:36.032407 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-2be9e14e-ec15-4da1-a2fc-b3df8a1547f2 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1561 microversion: 2.1 time: 0.154088 Nov 25 08:52:36.032972 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 620/1227] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:52:35 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:52:37.503064 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-92ea1578-b857-4e48-a566-5e91b3ca3bc0 req-369b4fca-b9eb-4f69-97bf-c5b3989d007d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9253a3-5d37-4a9e-b18b-999abafb8b56", "name": "network-vif-plugged", "status": "completed", "tag": "db687506-7dd4-4b8c-86c1-cb18b70d4715"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:52:37.504659 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:52:37.504659 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:52:37.511940 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-92ea1578-b857-4e48-a566-5e91b3ca3bc0 req-369b4fca-b9eb-4f69-97bf-c5b3989d007d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:52:37.512382 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-92ea1578-b857-4e48-a566-5e91b3ca3bc0 req-369b4fca-b9eb-4f69-97bf-c5b3989d007d service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:52:37.524404 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-92ea1578-b857-4e48-a566-5e91b3ca3bc0 req-369b4fca-b9eb-4f69-97bf-c5b3989d007d service nova] Creating event network-vif-plugged:db687506-7dd4-4b8c-86c1-cb18b70d4715 for instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 on hv-cinder-77819 Nov 25 08:52:37.529741 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-92ea1578-b857-4e48-a566-5e91b3ca3bc0 req-369b4fca-b9eb-4f69-97bf-c5b3989d007d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Nov 25 08:52:37.530381 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 608/1228] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:52:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:53:50.671179 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:53:50.672005 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:53:50.678624 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:50.679261 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:50.680161 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:50.681285 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:50.711271 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Going to try to terminate instance {{(pid=122641) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 25 08:53:50.795793 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-33e16457-20b4-41fd-bd12-b7461b9344eb tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 204 len: 0 microversion: 2.1 time: 0.129522 Nov 25 08:53:50.799898 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 621/1229] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Nov 25 08:53:50 2021] DELETE /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 25 08:53:50.807391 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:53:50.808259 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:53:50.814180 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:50.814709 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:50.816374 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:50.816984 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:50.821421 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [req-0bf5aa9e-5195-4396-8d41-612252eba5cb req-ec36ffb2-3d79-466b-a049-43a4c1499532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9253a3-5d37-4a9e-b18b-999abafb8b56", "tag": "db687506-7dd4-4b8c-86c1-cb18b70d4715"}]} {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:53:50.823193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:53:50.823193 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: warnings.warn(msg) Nov 25 08:53:50.831480 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-0bf5aa9e-5195-4396-8d41-612252eba5cb req-ec36ffb2-3d79-466b-a049-43a4c1499532 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:50.832907 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [req-0bf5aa9e-5195-4396-8d41-612252eba5cb req-ec36ffb2-3d79-466b-a049-43a4c1499532 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:50.846051 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.compute.server_external_events [req-0bf5aa9e-5195-4396-8d41-612252eba5cb req-ec36ffb2-3d79-466b-a049-43a4c1499532 service nova] Creating event network-changed:db687506-7dd4-4b8c-86c1-cb18b70d4715 for instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 on hv-cinder-77819 Nov 25 08:53:50.852706 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [req-0bf5aa9e-5195-4396-8d41-612252eba5cb req-ec36ffb2-3d79-466b-a049-43a4c1499532 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182349 Nov 25 08:53:50.853709 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 609/1230] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:53:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 25 08:53:51.046235 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.policy [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122641) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:53:51.053890 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-7db6d397-aca3-4b0c-87a5-5ec81b34a98c tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1567 microversion: 2.1 time: 0.252019 Nov 25 08:53:51.054463 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 622/1231] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:53:50 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:53:52.072974 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:53:52.073686 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:53:52.080229 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:52.080675 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:52.081494 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:52.081942 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:52.218356 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:53:52.231890 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-731443c6-4dc7-4968-bc84-487dd91ef615 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1450 microversion: 2.1 time: 0.163403 Nov 25 08:53:52.232469 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 610/1232] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:53:52 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:53:53.181650 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [req-56e5a7cc-6f57-4b66-b7b0-da82bfd36359 req-8a5733dc-3083-473d-8adc-18c76d7a7a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9253a3-5d37-4a9e-b18b-999abafb8b56", "name": "network-vif-deleted", "tag": "db687506-7dd4-4b8c-86c1-cb18b70d4715"}]} {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 25 08:53:53.183183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 25 08:53:53.183183 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: warnings.warn(msg) Nov 25 08:53:53.190418 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-56e5a7cc-6f57-4b66-b7b0-da82bfd36359 req-8a5733dc-3083-473d-8adc-18c76d7a7a82 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:53.190858 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [req-56e5a7cc-6f57-4b66-b7b0-da82bfd36359 req-8a5733dc-3083-473d-8adc-18c76d7a7a82 service nova] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:53.202317 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.compute.server_external_events [req-56e5a7cc-6f57-4b66-b7b0-da82bfd36359 req-8a5733dc-3083-473d-8adc-18c76d7a7a82 service nova] Creating event network-vif-deleted:db687506-7dd4-4b8c-86c1-cb18b70d4715 for instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 on hv-cinder-77819 Nov 25 08:53:53.207742 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [req-56e5a7cc-6f57-4b66-b7b0-da82bfd36359 req-8a5733dc-3083-473d-8adc-18c76d7a7a82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093052 Nov 25 08:53:53.208352 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 623/1233] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Nov 25 08:53:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 25 08:53:53.249699 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:53:53.250302 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.compute.api [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122643) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:53:53.256721 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:53.257149 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:53.257923 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:53.258443 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG oslo_concurrency.lockutils [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:53.320185 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.policy [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395156b79c794b13a07835c721de971d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f30271e57434c7bb827ede7add0c04b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122643) authorize /opt/stack/nova/nova/policy.py:199}} Nov 25 08:53:53.328608 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-4515d997-bec9-4d88-b35a-9d2bd167097e tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 200 len: 1219 microversion: 2.1 time: 0.082483 Nov 25 08:53:53.329360 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 611/1234] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:53:53 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 25 08:53:54.346740 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '>' {{(pid=122641) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:53:54.347452 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.compute.api [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] [instance: 3c9253a3-5d37-4a9e-b18b-999abafb8b56] Fetching instance by UUID {{(pid=122641) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 25 08:53:54.354148 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:54.354599 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:54.355393 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 25 08:53:54.355854 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG oslo_concurrency.lockutils [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Lock "66f22bb1-858d-4a3c-8a64-6d777ae46e0c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122641) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 25 08:53:54.369751 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.wsgi [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] HTTP exception thrown: Instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 could not be found. Nov 25 08:53:54.370354 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: DEBUG nova.api.openstack.wsgi [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Returning 404 to user: Instance 3c9253a3-5d37-4a9e-b18b-999abafb8b56 could not be found. {{(pid=122641) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 25 08:53:54.371186 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO nova.api.openstack.requestlog [None req-eb3be397-cf56-4fc1-8c34-9cf3e0ea89df tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56" status: 404 len: 111 microversion: 2.1 time: 0.029066 Nov 25 08:53:54.371791 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: [pid: 122641|app: 0|req: 624/1235] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Nov 25 08:53:54 2021] GET /compute/v2.1/servers/3c9253a3-5d37-4a9e-b18b-999abafb8b56 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 25 08:53:54.534172 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: DEBUG nova.api.openstack.wsgi [None req-6cc64065-a94d-4cc1-ac3e-7ef4a3cbd972 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] Calling method '.version_select at 0x7f9708651160>' {{(pid=122643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 25 08:53:54.554305 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO nova.api.openstack.requestlog [None req-6cc64065-a94d-4cc1-ac3e-7ef4a3cbd972 tempest-TestShelveInstance-1793456908 tempest-TestShelveInstance-1793456908-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1071915280" status: 202 len: 0 microversion: 2.1 time: 0.023778 Nov 25 08:53:54.554999 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: [pid: 122643|app: 0|req: 612/1236] 10.222.0.46 () {58 vars in 1253 bytes} [Thu Nov 25 08:53:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1071915280 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 25 08:55:19.771658 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:55:19.772447 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: Thu Nov 25 08:55:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:55:22.328476 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:55:22.329018 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:55:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:55:46.159176 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:55:46.159904 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:55:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:55:56.466250 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:55:56.466902 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:55:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:58:39.790107 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:58:39.790741 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: Thu Nov 25 08:58:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:58:42.346306 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:58:42.346943 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:58:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:58:57.688727 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:58:57.689279 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: Thu Nov 25 08:58:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:59:02.032295 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:59:02.033001 dv-cinder-778193-12-iscsi devstack@n-api.service[122643]: Thu Nov 25 08:59:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:59:06.176903 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:59:06.177487 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:59:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 25 08:59:16.483923 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 25 08:59:16.484631 dv-cinder-778193-12-iscsi devstack@n-api.service[122641]: Thu Nov 25 08:59:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!